Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
LLM Pretraining on C4 (Final val)
Loading...
18.288
Perplexity
SoftMuon
18.27116
18.38483
18.4985
18.61217
May 29, 2026
Perplexity
Updated 1d ago
Evaluation Results
Method
Method
Links
Perplexity
SoftMuon
Model=LLaMa 130M, Batc...
2026.05
18.288
SoftSignum
Model=LLaMa 130M, Batc...
2026.05
18.519
Muon
Model=LLaMa 130M, Batc...
2026.05
18.591
Signum
Model=LLaMa 130M, Batc...
2026.05
18.688
AdamW
Model=LLaMa 130M, Batc...
2026.05
18.709
Feedback
Search any
task
Search any
task