Long-context evaluation on RULER 16k
95.02Total Score
Full-KV
Updated 2d ago
Evaluation Results
| Method | Links | ||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
2026.02 | 95.02 | 100 | 100 | 100 | 100 | 99.8 | 100 | 99.95 | 99.85 | 100 | 97.7 | 96.2 | 79.4 | 62.4 | |
2026.02 | 94.1 | 100 | 100 | 100 | 99.4 | 99.6 | 96.6 | 96.7 | 89.8 | 97.2 | 60.8 | 95.5 | - | - | |
2026.02 | 93.6 | 100 | 99.8 | 92.6 | 99.6 | 99.2 | 93 | 97.3 | 94.9 | 95.4 | 74.5 | 80.4 | - | - | |
2026.02 | 93 | 100 | 100 | 100 | 98.6 | 100 | 96.4 | 99.2 | 99.4 | 94.4 | 37.1 | 97.4 | - | - | |
2026.02 | 91.6 | 100 | 100 | 99.8 | 97.6 | 99.8 | 96.6 | 97.4 | 94.7 | 99.1 | 23.7 | 98.5 | - | - | |
2026.02 | 90.6 | 100 | 99.8 | 99 | 98.2 | 100 | 99.6 | 92.2 | 91.3 | 90.3 | 40.2 | 86.4 | - | - | |
2026.02 | 88.88 | 100 | 100 | 100 | 100 | 86.6 | 46.8 | 99.95 | 99.25 | 100 | 96.02 | 96.2 | 71.6 | 59 | |
2026.02 | 88.57 | - | - | - | - | - | - | - | - | - | - | - | - | - | |
2026.02 | 86.63 | 94.2 | 96.4 | 99.6 | 97.4 | 95.6 | 76.8 | 88.65 | 89.5 | 96.28 | 82.22 | 87.93 | 71.6 | 50 | |
2026.02 | 80.81 | 100 | 100 | 100 | 99.8 | 44.2 | 23 | 99.9 | 99 | 99.88 | 95.34 | 99.07 | 44 | 46.4 | |
2026.02 | 80.47 | 99.8 | 99.2 | 32 | 84.2 | 71.8 | 78.4 | 85.8 | 84.6 | 99.72 | 95.66 | 93.13 | 65 | 56.8 | |
2026.02 | 79.66 | 85.6 | 76.6 | 100 | 87 | 90.8 | 35.2 | 92.85 | 96.45 | 92.16 | 80.78 | 86.8 | 64.6 | 46.8 | |
2026.02 | 74.98 | 100 | 100 | 100 | 100 | 8 | 1 | 99.95 | 99.4 | 98.92 | 90.36 | 99.33 | 36.4 | 41.4 | |
2026.02 | 73.4 | - | - | - | - | - | - | - | - | - | - | - | - | - | |
2026.02 | 72.7 | 95.2 | 94.8 | 70.8 | 93.2 | 86.4 | 69.4 | 83.2 | 57.8 | 66.7 | 13.3 | 69.2 | - | - | |
2026.02 | 72.69 | - | - | - | - | - | - | - | - | - | - | - | - | - | |
2026.02 | 70.9 | - | - | - | - | - | - | - | - | - | - | - | - | - | |
2026.02 | 70.68 | 100 | 100 | 99.8 | 99.6 | 1 | 0.2 | 99.95 | 99.55 | 84.52 | 69.26 | 98.93 | 30.2 | 35.8 | |
2026.02 | 69.98 | 70.8 | 78.8 | 18.2 | 83.6 | 79.2 | 67.4 | 76.25 | 67.8 | 95.88 | 78.32 | 84.47 | 62 | 47 | |
2026.02 | 67.51 | 92.6 | 91.2 | 97.4 | 87.8 | 6.8 | 1.2 | 86.45 | 88 | 91.28 | 75.44 | 86.47 | 36.4 | 36.6 | |
2026.02 | 66.82 | - | - | - | - | - | - | - | - | - | - | - | - | - | |
2026.02 | 65.7 | 94.6 | 72.8 | 100 | 78.8 | 7.4 | 0.8 | 86.1 | 94.8 | 94.16 | 65.56 | 90.87 | 32.4 | 35.8 | |
2026.02 | 65.57 | 93.2 | 96.2 | 99.6 | 88.2 | 6.6 | 0.6 | 89.75 | 92 | 94.36 | 36.92 | 88.73 | 31.4 | 34.8 | |
2026.02 | 59.57 | - | - | - | - | - | - | - | - | - | - | - | - | - | |
2026.02 | 59.1 | - | - | - | - | - | - | - | - | - | - | - | - | - | |
2026.02 | 56.64 | - | - | - | - | - | - | - | - | - | - | - | - | - | |
2026.02 | 56.02 | - | - | - | - | - | - | - | - | - | - | - | - | - | |
2026.02 | 54.71 | - | - | - | - | - | - | - | - | - | - | - | - | - | |
2026.02 | 54.67 | - | - | - | - | - | - | - | - | - | - | - | - | - | |
2026.02 | 53.91 | - | - | - | - | - | - | - | - | - | - | - | - | - | |
2026.02 | 52.29 | - | - | - | - | - | - | - | - | - | - | - | - | - | |
2026.02 | 50.1 | - | - | - | - | - | - | - | - | - | - | - | - | - | |
2026.02 | 48.96 | - | - | - | - | - | - | - | - | - | - | - | - | - | |
2026.02 | 48.59 | - | - | - | - | - | - | - | - | - | - | - | - | - | |
2026.02 | 48.31 | - | - | - | - | - | - | - | - | - | - | - | - | - | |
2026.02 | 44.04 | 98.8 | 52.6 | 4.4 | 21.8 | 7 | 4.2 | 18.25 | 14.75 | 99.32 | 88.48 | 94.53 | 29.4 | 39 | |
2026.02 | 43.91 | 97.4 | 55.6 | 3.8 | 25.8 | 4.8 | 2 | 19.6 | 14.4 | 99.28 | 87.14 | 94 | 28 | 39 | |
2026.02 | 41.64 | - | - | - | - | - | - | - | - | - | - | - | - | - | |
2026.02 | 38.27 | - | - | - | - | - | - | - | - | - | - | - | - | - | |
2026.02 | 37.48 | 58 | 38.8 | 2.4 | 20.2 | 12.4 | 5.6 | 16.8 | 12.85 | 92.08 | 71.36 | 86.13 | 33.6 | 37 | |
2026.02 | 36.83 | 83.8 | 36 | 2.4 | 19.2 | 2 | 0 | 14.95 | 13.15 | 93.68 | 56.84 | 95.73 | 26.4 | 34.6 | |
2026.02 | 35.12 | - | - | - | - | - | - | - | - | - | - | - | - | - | |
2026.02 | 32.43 | 50 | 57 | 2.4 | 28 | 4.8 | 0.2 | 21.55 | 16.15 | 62.32 | 31.94 | 82.2 | 32 | 33 | |
2026.02 | 32.18 | - | - | - | - | - | - | - | - | - | - | - | - | - | |
2026.02 | 30.75 | - | - | - | - | - | - | - | - | - | - | - | - | - | |
2026.02 | 30.44 | - | - | - | - | - | - | - | - | - | - | - | - | - | |
2026.02 | 29.53 | 40.4 | 16.2 | 2.4 | 14.2 | 6.2 | 1 | 11 | 9.65 | 66.92 | 66.96 | 85.53 | 29.8 | 33.6 | |
2026.02 | 25.76 | - | - | - | - | - | - | - | - | - | - | - | - | - | |
2026.02 | 24.82 | - | - | - | - | - | - | - | - | - | - | - | - | - | |
2026.02 | 24.39 | - | - | - | - | - | - | - | - | - | - | - | - | - | |
2026.02 | 24.29 | - | - | - | - | - | - | - | - | - | - | - | - | - | |
2026.02 | 24.21 | - | - | - | - | - | - | - | - | - | - | - | - | - | |
2026.02 | 20.94 | - | - | - | - | - | - | - | - | - | - | - | - | - | |
2026.02 | 15.86 | - | - | - | - | - | - | - | - | - | - | - | - | - | |
2026.02 | 15.79 | - | - | - | - | - | - | - | - | - | - | - | - | - | |
2026.02 | 12.84 | - | - | - | - | - | - | - | - | - | - | - | - | - | |
2026.02 | 12.44 | - | - | - | - | - | - | - | - | - | - | - | - | - | |
2026.02 | 10.94 | - | - | - | - | - | - | - | - | - | - | - | - | - | |
2026.02 | 9.88 | - | - | - | - | - | - | - | - | - | - | - | - | - |