Long-context language understanding on RULER 128k
49.11Average Score
Vanilla
Updated 4d ago
Evaluation Results
| Method | Links | |||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
2025.12 | 49.11 | 89 | 78.67 | 94 | 63 | 16 | 29 | 27 | 90 | 82 | 28 | 21 | 12.8 | |
2025.12 | 42.31 | 78.3 | 75.67 | 91 | 18 | 0.75 | 28.5 | 98 | 97 | 18 | 20 | 19 | 5.8 | |
2025.12 | 42 | 71.3 | 64 | 85 | 4 | 5.25 | 40.25 | 42 | 90 | 87 | 27 | 16 | 10.2 | |
2025.12 | 17.32 | 25 | 76 | 8 | 31 | 1.5 | 0 | 47 | 0 | 0 | 21 | 14 | 1.6 |