Online Language Modeling on PG-19 (Whole Book)
18.87PPL @ 50K
TTT w/ Locas-MLP + NL-SVD
Updated 4d ago
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
2026.02 | 18.87 | 18.46 | 18.23 | 17.89 | |
2026.02 | 18.89 | 18.44 | 18.22 | 17.9 | |
2026.02 | 18.94 | 18.47 | 18.25 | 17.93 | |
2026.02 | 18.98 | 18.64 | 18.54 | 18.31 | |
2026.02 | 18.98 | 18.7 | 18.53 | 18.58 | |
2026.02 | 19.35 | 19.03 | 18.92 | 18.72 | |
2026.02 | 20 | 19.49 | 19.12 | 19.04 | |
2026.02 | 20.03 | 19.55 | 19.2 | 19.13 | |
2026.02 | 20.6 | 20.38 | 20.25 | 20.5 | |
2026.02 | 23.65 | 22.55 | 21.92 | 21.65 | |
2026.02 | 23.74 | 22.57 | 21.92 | 21.65 | |
2026.02 | 25.24 | 24.79 | 24.55 | 24.57 | |
2026.02 | 26.58 | 25.76 | 25.21 | 25 | |
2026.02 | 26.71 | 25.94 | 25.42 | 25.22 | |
2026.02 | 27.49 | 27.13 | 26.94 | 27.28 | |
2026.02 | 31.45 | 31.18 | 30.97 | 31.03 | |
2026.02 | 31.59 | 31.27 | 31.09 | 31.49 |