Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Language Modeling on SlimPajama-672B (val)
Loading...
8.09
Validation Perplexity
KLA
8.0372
8.3936
8.75
9.1064
May 9, 2026
Validation Perplexity
Updated 22d ago
Evaluation Results
Method
Method
Links
Validation Perplexity
KLA
Model Scale=0.4B, Trai...
2026.05
8.09
DeltaNet
Model Scale=0.4B, Trai...
2026.05
8.26
GLA
Model Scale=0.4B, Trai...
2026.05
8.42
GDN
Model Scale=0.4B, Trai...
2026.05
8.5
Longhorn
Model Scale=0.4B, Trai...
2026.05
8.79
Mamba2
Model Scale=0.4B, Trai...
2026.05
9.41
Feedback
Search any
task
Search any
task
