Long-context language understanding on RULER 16k context length
94.73Average Score
RetroInfer
Updated 3d ago
Evaluation Results
| Method | Links | ||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
2025.11 | 94.73 | - | - | - | - | - | - | - | - | - | - | - | |
2025.11 | 94.36 | - | - | - | - | - | - | - | - | - | - | - | |
2025.11 | 94.35 | - | - | - | - | - | - | - | - | - | - | - | |
2025.11 | 94.06 | - | - | - | - | - | - | - | - | - | - | - | |
2025.11 | 92.78 | - | - | - | - | - | - | - | - | - | - | - | |
2025.11 | 86.56 | - | - | - | - | - | - | - | - | - | - | - | |
2025.11 | 86.36 | - | - | - | - | - | - | - | - | - | - | - | |
2025.11 | 86.07 | - | - | - | - | - | - | - | - | - | - | - | |
2025.11 | 85.65 | - | - | - | - | - | - | - | - | - | - | - | |
2025.11 | 79.7 | - | - | - | - | - | - | - | - | - | - | - | |
2026.02 | 64.6 | 100 | 93 | 95.7 | 81 | 19.8 | 0 | 74.2 | 53.4 | - | - | - | |
2026.02 | 61.4 | 100 | 81.8 | 96.3 | 68.7 | 19.6 | 0 | 71 | 53.4 | - | - | - | |
2026.01 | 50.6 | - | - | - | - | - | - | - | - | - | - | - | |
2026.01 | 40.2 | - | - | - | - | - | - | - | - | - | - | - | |
2026.01 | 23.4 | - | - | - | - | - | - | - | - | - | - | - | |
2026.01 | 20.6 | - | - | - | - | - | - | - | - | - | - | - | |
2026.02 | - | 100 | 100 | 98.5 | 97 | 97.4 | 93.17 | 80.5 | 51.5 | - | - | - | |
2026.02 | - | 100 | 100 | 98 | 97 | 97.5 | 93.17 | 79.5 | 51.5 | - | - | - | |
2026.02 | - | 100 | 100 | 97.5 | 98.5 | 97.6 | 93.17 | 73.5 | 48 | - | - | - | |
2026.02 | - | 100 | 100 | 94 | 98 | 96.2 | 93.83 | 76 | 48 | - | - | - | |
2026.02 | - | 100 | 100 | 98 | 99 | 89 | 91.33 | 73 | 45.5 | - | - | - | |
2026.02 | - | 100 | 100 | 98.5 | 98.25 | 88.8 | 88.67 | 88 | 54 | - | - | - | |
2024.09 | - | - | - | - | - | 2 | 4 | - | - | 36.78 | 5.8 | 52 | |
2024.09 | - | - | - | - | - | 1.4 | 5.33 | - | - | 38.88 | 3.9 | 29 | |
2024.09 | - | - | - | - | - | 0 | 27.33 | - | - | 32.75 | 2 | 15.5 | |
2024.09 | - | - | - | - | - | 0 | 2.67 | - | - | 0.41 | 20.9 | 20 | |
2024.09 | - | - | - | - | - | 1.6 | 10.33 | - | - | 2.06 | 7.3 | 28.5 | |
2024.09 | - | - | - | - | - | 5.4 | 2.33 | - | - | 6 | 6.4 | 40 | |
2024.09 | - | - | - | - | - | 10.2 | 3 | - | - | 57.78 | 0.7 | 1 |