Long-context language understanding on RULER 16k context length
0FWE Score
Full Attention
Updated 20d ago
Evaluation Results
| Method | Links | ||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
2026.02 | 0 | 100 | 93 | 95.7 | 81 | 19.8 | 74.2 | 53.4 | 64.6 | - | - | - | |
2026.02 | 0 | 100 | 81.8 | 96.3 | 68.7 | 19.6 | 71 | 53.4 | 61.4 | - | - | - | |
2024.09 | 2.33 | - | - | - | - | 5.4 | - | - | - | 6 | 6.4 | 40 | |
2024.09 | 2.67 | - | - | - | - | 0 | - | - | - | 0.41 | 20.9 | 20 | |
2024.09 | 3 | - | - | - | - | 10.2 | - | - | - | 57.78 | 0.7 | 1 | |
2024.09 | 4 | - | - | - | - | 2 | - | - | - | 36.78 | 5.8 | 52 | |
2024.09 | 5.33 | - | - | - | - | 1.4 | - | - | - | 38.88 | 3.9 | 29 | |
2024.09 | 10.33 | - | - | - | - | 1.6 | - | - | - | 2.06 | 7.3 | 28.5 | |
2024.09 | 27.33 | - | - | - | - | 0 | - | - | - | 32.75 | 2 | 15.5 | |
2026.05 | 29.83 | - | - | - | - | - | - | - | - | - | 15.9 | - | |
2026.05 | 43 | - | - | - | - | - | - | - | - | - | 19.35 | - | |
| 44.83 | - | - | - | - | - | - | - | - | - | 41.45 | - | ||
2026.05 | 46.17 | - | - | - | - | - | - | - | - | - | 20.15 | - | |
| 47.5 | - | - | - | - | - | - | - | - | - | 20.05 | - | ||
2026.05 | 48.33 | - | - | - | - | - | - | - | - | - | 18.15 | - | |
2026.02 | 88.67 | 100 | 100 | 98.5 | 98.25 | 88.8 | 88 | 54 | - | - | - | - | |
2026.02 | 91.33 | 100 | 100 | 98 | 99 | 89 | 73 | 45.5 | - | - | - | - | |
2026.02 | 93.17 | 100 | 100 | 98.5 | 97 | 97.4 | 80.5 | 51.5 | - | - | - | - | |
2026.02 | 93.17 | 100 | 100 | 98 | 97 | 97.5 | 79.5 | 51.5 | - | - | - | - | |
2026.02 | 93.17 | 100 | 100 | 97.5 | 98.5 | 97.6 | 73.5 | 48 | - | - | - | - | |
2026.02 | 93.83 | 100 | 100 | 94 | 98 | 96.2 | 76 | 48 | - | - | - | - | |
2026.01 | - | - | - | - | - | - | - | - | 20.6 | - | - | - | |
2026.01 | - | - | - | - | - | - | - | - | 23.4 | - | - | - | |
2026.01 | - | - | - | - | - | - | - | - | 40.2 | - | - | - | |
2026.01 | - | - | - | - | - | - | - | - | 50.6 | - | - | - | |
2025.11 | - | - | - | - | - | - | - | - | 94.35 | - | - | - | |
2025.11 | - | - | - | - | - | - | - | - | 94.73 | - | - | - | |
2025.11 | - | - | - | - | - | - | - | - | 92.78 | - | - | - | |
2025.11 | - | - | - | - | - | - | - | - | 94.06 | - | - | - | |
2025.11 | - | - | - | - | - | - | - | - | 94.36 | - | - | - | |
2025.11 | - | - | - | - | - | - | - | - | 86.07 | - | - | - | |
2025.11 | - | - | - | - | - | - | - | - | 86.36 | - | - | - | |
2025.11 | - | - | - | - | - | - | - | - | 79.7 | - | - | - | |
2025.11 | - | - | - | - | - | - | - | - | 86.56 | - | - | - | |
2025.11 | - | - | - | - | - | - | - | - | 85.65 | - | - | - |