Long-context modeling on RULER
90.2NIAH Score (MK, 1K)
Transformer
Updated 2d ago
Evaluation Results
| Method | Links | ||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
2025.10 | 90.2 | 63.2 | 0.4 | 81.8 | 64.3 | 13.1 | 42.9 | 20.9 | 0 | 21.3 | 2.8 | 0.6 | |
2025.10 | 81.4 | 51.8 | 21.6 | 62.7 | 50.6 | 28.4 | 63.8 | 33.2 | 9.3 | 27.4 | 26 | 24.8 | |
2025.10 | 59.6 | 29.4 | 15 | 56.1 | 41.4 | 27.1 | 64.7 | 31 | 4.1 | 26.5 | 21.6 | 16.8 | |
2025.10 | 46 | 23.6 | 12.4 | 37.9 | 30.1 | 25 | 50.4 | 12.7 | 10.4 | 26.2 | 20.6 | 19.2 | |
2025.10 | 20 | 11.2 | 6.4 | 77.7 | 68.5 | 34.4 | 42.1 | 24.4 | 15.4 | 24.8 | 20.6 | 18 | |
2025.10 | 13.6 | 3.8 | 4.8 | 52.5 | 55.8 | 35 | 14.5 | 9 | 8.5 | 4.4 | 19.4 | 16 |