Share your thoughts, 1 month free Claude Pro on us
See more
Feedback
Search any
task
Search any
task
SOTA Pre-training benchmarks and papers with code | Wizwand
Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Tasks
Pre-training
Benchmarks
Dataset Name
SOTA Method
Dataset Name
SOTA Method
Metric
Trend
Results
Last Updated
C4 (val)
ADAMW + GradientStabilizer
Perplexity
17.8
58
6d ago
Pre-training (evaluation)
BHyT
Pre-training Eval Loss
3.254
5
1mo ago
FineWeb 124M Transformer (val)
Best Human Expert
Training Time to Loss 3.28 (min)
2.1
3
1mo ago
Showing 3 of 3 rows
25 / page
50 / page
100 / page
1
Search any
task
Search any
task
