Share your thoughts, 1 month free Claude Pro on usSee more

Scaling-law extrapolation on TinyStories high-C holdout

0.095RMSE (log space)

Muennighoff

Updated 22d ago

Evaluation Results

Method	Links
Muennighoff 2026.05		0.095
Farseer 2026.05		0.119
Chinchilla 2026.05		0.173
Ours (Eq. (2)) 2026.05		0.184
BNSL k=2 2026.05		0.324
M4 (D-axis) 2026.05		0.337