Language Modeling on The Pile (val) (Loss and PPL)
4.24PPL
AC-ODM
Updated 1mo ago
Evaluation Results
| Method | Links | ||
|---|---|---|---|
2025.05 | 4.24 | - | |
2026.06 | 4.89 | - | |
2026.05 | 5.432 | 1.6923 | |
2026.05 | 5.4736 | 1.6999 | |
2026.05 | 5.5683 | 1.7171 | |
2026.05 | 5.6186 | 1.726 | |
2026.05 | 5.6458 | 1.7309 | |
2026.05 | 5.794 | 1.7568 | |
2026.05 | 5.8334 | 1.7636 | |
2025.05 | 5.91 | - | |
2026.05 | 6.0388 | 1.7982 | |
2026.06 | 6.04 | - | |
2026.05 | 6.0694 | 1.8032 | |
2026.05 | 6.184 | 1.822 | |
2026.05 | 6.2453 | 1.8318 | |
2026.05 | 6.593 | 1.886 | |
2026.05 | 6.7058 | 1.9029 | |
2026.05 | 6.9012 | 1.9317 | |
2026.06 | 7.25 | - | |
2026.06 | 7.27 | - | |
2026.06 | 7.3 | - | |
2025.05 | 7.32 | - | |
2026.06 | 7.32 | - | |
2026.06 | 7.35 | - | |
2026.06 | 7.55 | - | |
2025.05 | 7.56 | - | |
2026.05 | 7.708 | 2.042 | |
2026.06 | 7.77 | - | |
2026.06 | 7.78 | - | |
2026.06 | 7.88 | - | |
2026.06 | 7.88 | - | |
2026.06 | 8.17 | - | |
2026.06 | 8.19 | - | |
2025.05 | 8.55 | - | |
2026.06 | 8.55 | - | |
2025.05 | 10.01 | - | |
2026.06 | 10.01 | - | |
2025.05 | 12.87 | - | |
2026.06 | 13.46 | - | |
2025.05 | 14.53 | - | |
2026.06 | 14.53 | - |