Our new X account is live! Follow @wizwand_team for updates
Home
/
Benchmarks
Language Model Pre-training on Datacomp-LM 400M-1x scale 1.0
Loading...
17.9
Core Score
DCLM-baseline + SIEVE
16.808
17.0915
17.375
17.6585
Oct 3, 2024
Core Score
Extended Score
MMLU Score
Updated 4d ago
Evaluation Results
Method
Method
Links
Core Score
Extended Score
MMLU Score
DCLM-baseline + SIEVE
Training Tokens=8.2B,...
2024.10
17.9
10.08
25.99
DCLM-baseline (reproduced)
Training Tokens=8.2B,...
2024.10
17.61
9.46
23.89
Fineweb-edu (reproduced)
Training Tokens=8.2B,...
2024.10
16.85
8.46
23.32
Feedback
Search any
task
Search any
task