Language Modeling on Wikitext-103 (PPL and Delta PPL)
3.14PPL
BF16 (Pretrained)
Updated 4d ago
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
2025.02 | 3.14 | - | - | - | |
2025.02 | 3.2 | 0.06 | - | - | |
2025.02 | 3.23 | 0.09 | - | - | |
2025.02 | 3.35 | 0.21 | - | - | |
2025.02 | 3.48 | - | - | - | |
2025.02 | 3.56 | 0.08 | - | - | |
2025.02 | 3.58 | 0.44 | - | - | |
2025.02 | 3.6 | 0.12 | - | - | |
2025.02 | 3.67 | 0.19 | - | - | |
2025.02 | 3.69 | 0.55 | - | - | |
2025.02 | 4.01 | 0.53 | - | - | |
2025.02 | 4.1 | 0.62 | - | - | |
2025.02 | 4.19 | 0.71 | - | - | |
2025.02 | 4.96 | 1.82 | - | - | |
2025.02 | 5.06 | - | - | - | |
2025.02 | 5.15 | 0.09 | - | - | |
2025.02 | 5.19 | 0.13 | - | - | |
2025.02 | 5.31 | 0.25 | - | - | |
2025.02 | 5.73 | 0.67 | - | - | |
2025.02 | 5.76 | 0.7 | - | - | |
2025.02 | 5.87 | - | - | - | |
2025.02 | 6.03 | 0.16 | - | - | |
2025.02 | 6.13 | 0.26 | - | - | |
2025.02 | 6.3 | 0.43 | - | - | |
2025.02 | 6.54 | - | - | - | |
2025.02 | 6.59 | 0.05 | - | - | |
2025.02 | 6.62 | 0.08 | - | - | |
2025.02 | 6.74 | 0.2 | - | - | |
2025.02 | 7.12 | 0.58 | - | - | |
2025.02 | 7.38 | - | - | - | |
2025.02 | 7.45 | 0.07 | - | - | |
2025.02 | 7.48 | 0.1 | - | - | |
2025.02 | 7.58 | 1.71 | - | - | |
2025.02 | 7.61 | 0.23 | - | - | |
2025.02 | 7.69 | 1.15 | - | - | |
2025.02 | 8.15 | 0.77 | - | - | |
2025.02 | 8.17 | 0.79 | - | - | |
2025.02 | 8.24 | 2.37 | - | - | |
2025.02 | 8.88 | 3.01 | - | - | |
2025.02 | 9.12 | 1.74 | - | - | |
2025.02 | 10.18 | 3.64 | - | - | |
2025.02 | 835 | 829 | - | - | |
2025.02 | - | - | 0.14 | 0.09 | |
2025.02 | - | - | 0.12 | 0.07 | |
2025.02 | - | - | 0.09 | 0.06 | |
2025.02 | - | - | 0.08 | 0.05 |