Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Language Modeling on RefinedWeb (val)
Loading...
18.398
Perplexity
MLRA
18.36584
18.58292
18.8
19.01708
Mar 2, 2026
Perplexity
Updated 3mo ago
Evaluation Results
Method
Method
Links
Perplexity
MLRA
Branches=4
2026.03
18.398
GLA
Branches=2
2026.03
18.509
MLA
2026.03
18.523
GLA
Branches=4
2026.03
18.578
MLRA
Branches=2
2026.03
18.602
MHA
2026.03
18.698
GQA
2026.03
18.885
GTA
2026.03
18.924
TPA
2026.03
18.971
MFA
2026.03
19.125
MQA
2026.03
19.202
Feedback
Search any
task
Search any
task
