Share your thoughts, 1 month free Claude Pro on usSee more

Language Modeling on FineWeb-EDU (train)

2.993Loss

sHC

Updated 26d ago

Evaluation Results

Method	Links
sHC 2026.03		2.993	-	-	-
mHC-lite 2026.03		3.013	-	-	-
mHC 2026.03		3.017	-	-	-
RC 2026.03		3.058	-	-	-
HC 2026.03		3.112	-	-	-
sHC 2026.03		3.23	-	-	-
mHC 2026.03		3.241	-	-	-
mHC-lite 2026.03		3.241	-	-	-
HC 2026.03		3.276	-	-	-
RC 2026.03		3.313	-	-	-
AdamW 2026.03		-	10.83	25.12	37.62
Muon 2026.03		-	10.01	25.39	32.51
NuMuon 2026.03		-	10.59	30.03	33.88