Our new X account is live! Follow @wizwand_team for updates
Home
/
Benchmarks
LLM Pretraining on FineWeb-Edu (train)
Loading...
2.964
Training Loss
mHC
2.94284
3.08567
3.2285
3.37133
Jan 29, 2026
Training Loss
Updated 4d ago
Evaluation Results
Method
Method
Links
Training Loss
mHC
D (Number of transform...
2026.01
2.964
KromHC
D (Number of transform...
2026.01
2.966
Residual
D (Number of transform...
2026.01
2.971
mHC-lite
D (Number of transform...
2026.01
2.972
mHC-lite
D (Number of transform...
2026.01
3.484
KromHC
D (Number of transform...
2026.01
3.488
Residual
D (Number of transform...
2026.01
3.49
mHC
D (Number of transform...
2026.01
3.493
Feedback
Search any
task
Search any
task