Language Modeling on FineWeb-Edu 10K steps (val)
3.372Validation Loss
Delta AttnRes
Updated 14d ago
Evaluation Results
| Method | Links | ||
|---|---|---|---|
2026.05 | 3.372 | 29.13 | |
2026.05 | 3.374 | 29.19 | |
2026.05 | 3.391 | 29.7 | |
2026.05 | 3.436 | 31.05 | |
2026.05 | 3.439 | 31.16 | |
2026.05 | 3.456 | 31.68 | |
2026.05 | 3.458 | 31.75 | |
2026.05 | 3.458 | 31.76 | |
2026.05 | 3.466 | 32 | |
2026.05 | 3.508 | 33.36 | |
2026.05 | 3.606 | 36.83 | |
2026.05 | 3.613 | 37.08 | |
2026.05 | 3.619 | 37.3 | |
2026.05 | 3.622 | 37.39 | |
2026.05 | 3.656 | 38.71 |