Language Modeling on WikiText-2 (test) (Context Length 4096)
5.11PPL (WikiText-2)
Baseline (Ours)
Updated 1mo ago
Evaluation Results
| Method | Links | |
|---|---|---|
2026.03 | 5.11 | |
| 5.48 | ||
2026.03 | 5.6 | |
2026.03 | 5.84 | |
2026.03 | 5.86 | |
2026.03 | 6.19 | |
2026.02 | 6.36 | |
2026.02 | 6.74 | |
| 6.83 | ||
2026.03 | 6.93 | |
2026.03 | 7.61 | |
2026.02 | 8.11 | |
2026.03 | 8.22 | |
2026.02 | 8.89 | |
2026.02 | 30,000 |