Our new X account is live! Follow @wizwand_team for updates
Search any
task
Feedback
Search any
task
SOTA Pre-training benchmarks and papers with code | Wizwand
Our new X account is live! Follow @wizwand_team for updates
Home
/
Tasks
Pre-training
Benchmarks
Dataset Name
SOTA Method
Dataset Name
SOTA Method
Metric
Trend
Results
Last Updated
C4 (val)
Full-Rank
Perplexity
25.08
10
4d ago
Pre-training (evaluation)
BHyT
Pre-training Eval Loss
3.254
5
4d ago
FineWeb 124M Transformer (val)
Best Human Expert
Training Time to Loss 3.28 (min)
2.1
3
4d ago
Showing 3 of 3 rows
25 / page
50 / page
100 / page
1
Search any
task
Search any
task
