Language Modeling on FineWeb-Edu 500M-token (val)
2.221Valid Loss
FusedKV
Updated 4d ago
Evaluation Results
| Method | Links | |
|---|---|---|
2025.12 | 2.221 | |
2025.12 | 2.225 | |
2025.12 | 2.241 | |
2025.12 | 2.244 | |
2025.12 | 2.245 | |
2025.12 | 2.258 | |
2025.12 | 2.473 | |
2025.12 | 2.474 | |
2025.12 | 2.483 | |
2025.12 | 2.497 | |
2025.12 | 2.498 | |
2025.12 | 2.511 | |
2025.12 | 2.639 | |
2025.12 | 2.642 | |
2025.12 | 2.651 | |
2025.12 | 2.662 | |
2025.12 | 2.663 | |
2025.12 | 2.676 |