Language Modeling on OpenWebText ctx len. 1024 (val)
21.43Perplexity
PGM 6 / 6 (dim. 1024)
Updated 4d ago
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
2025.05 | 21.43 | 5.93 | 5,518.09 | |
2025.05 | 22.61 | 5.86 | 5,585.57 | |
2025.05 | 22.98 | 31.41 | 1,043.22 | |
2025.05 | 23.07 | 31.41 | 1,043.22 |