Long-context language understanding on RULER 128k
89.49Accuracy
RetroInfer
Updated 19d ago
Evaluation Results
| Method | Links | ||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
2025.11 | 89.49 | - | - | - | - | - | - | - | - | - | - | - | - | - | |
2025.11 | 88.94 | - | - | - | - | - | - | - | - | - | - | - | - | - | |
2025.11 | 88.85 | - | - | - | - | - | - | - | - | - | - | - | - | - | |
2025.11 | 88.47 | - | - | - | - | - | - | - | - | - | - | - | - | - | |
2025.11 | 85.26 | - | - | - | - | - | - | - | - | - | - | - | - | - | |
2025.11 | 73.87 | - | - | - | - | - | - | - | - | - | - | - | - | - | |
2025.11 | 73.44 | - | - | - | - | - | - | - | - | - | - | - | - | - | |
2025.11 | 72.96 | - | - | - | - | - | - | - | - | - | - | - | - | - | |
2025.11 | 72.73 | - | - | - | - | - | - | - | - | - | - | - | - | - | |
2025.11 | 69.37 | - | - | - | - | - | - | - | - | - | - | - | - | - | |
2025.12 | - | 49.11 | 89 | 78.67 | 94 | 63 | 16 | 29 | 27 | 90 | 82 | 28 | 21 | 12.8 | |
2025.12 | - | 17.32 | 25 | 76 | 8 | 31 | 1.5 | 0 | 47 | 0 | 0 | 21 | 14 | 1.6 | |
2025.12 | - | 42.31 | 78.3 | 75.67 | 91 | 18 | 0.75 | 28.5 | 98 | 97 | 18 | 20 | 19 | 5.8 | |
2025.12 | - | 42 | 71.3 | 64 | 85 | 4 | 5.25 | 40.25 | 42 | 90 | 87 | 27 | 16 | 10.2 |