Our new X account is live! Follow @wizwand_team for updates
Home
/
Benchmarks
LLM Pretraining on FineWeb-Edu (val)
Loading...
0.861
BPB
mHC
0.85356
0.90378
0.954
1.00422
Jan 29, 2026
BPB
Updated 4d ago
Evaluation Results
Method
Method
Links
BPB
mHC
D (Number of transform...
2026.01
0.861
KromHC
D (Number of transform...
2026.01
0.862
Residual
D (Number of transform...
2026.01
0.864
mHC-lite
D (Number of transform...
2026.01
0.864
mHC
D (Number of transform...
2026.01
1.042
mHC-lite
D (Number of transform...
2026.01
1.045
Residual
D (Number of transform...
2026.01
1.047
KromHC
D (Number of transform...
2026.01
1.047
Feedback
Search any
task
Search any
task