Long-context language understanding on LongBench (Comprehensive Metric Set)
32.3NQA
KEYDIFF
Updated 1mo ago
Evaluation Results
| Method | Links | |||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
2026.04 | 32.3 | 44.93 | 52.98 | 55.52 | 46.6 | 30.26 | 32.45 | 24.47 | 25.71 | 64 | 87.29 | 40.35 | 10.65 | 99.5 | 45.18 | 46.77 | 46.18 | |
2026.04 | 31.69 | 44.84 | 51.42 | 58.24 | 48.35 | 30.66 | 33.88 | 24.65 | 26.47 | 65.25 | 90.71 | 37.72 | 12 | 98.5 | 50.12 | 49.47 | 47.12 | |
2026.04 | 31.53 | 47.74 | 56.95 | 57.31 | 51.9 | 32.91 | 34.61 | 24.65 | 26.78 | 68.5 | 90.21 | 38.8 | 13.65 | 100 | 53.47 | 48.52 | 48.6 | |
2026.04 | 31.5 | 47.2 | 54.17 | 58.79 | 50.95 | 35.85 | 34.48 | 24.77 | 26.83 | 62.5 | 86.56 | 40.13 | 10.65 | 99.5 | 52.25 | 47.03 | 47.7 | |
2026.04 | 31.19 | 46.67 | 51.49 | 56.34 | 48.65 | 33.48 | 33.63 | 24.74 | 27.04 | 19 | 85.91 | 38.87 | 12.5 | 87 | 52.97 | 48.64 | 43.63 | |
2026.04 | 31.17 | 47.49 | 56.85 | 58.33 | 49.98 | 33.82 | 34.94 | 24.78 | 27.18 | 29.5 | 85.66 | 38.03 | 11.2 | 99 | 52.49 | 47.54 | 45.5 | |
2026.04 | 30.71 | 45.34 | 56.16 | 58.43 | 50.63 | 35.27 | 34.07 | 24.83 | 26.67 | 66 | 87.26 | 36.85 | 11.15 | 97.5 | 36.91 | 48.35 | 46.63 | |
2026.04 | 30.46 | 47.27 | 55.98 | 59 | 51.23 | 33.55 | 35.24 | 25.27 | 26.8 | 29.5 | 86.01 | 39.31 | 10.65 | 100 | 53.47 | 47.73 | 45.72 | |
2026.04 | 30.17 | 39.7 | 41.55 | 55.53 | 44.55 | 26.75 | 31.77 | 23.26 | 26.06 | 27 | 88.98 | 38.59 | 10 | 45 | 49.84 | 50.01 | 39.3 | |
2026.04 | 30.02 | 45.2 | 55.16 | 58.3 | 52.01 | 32.56 | 33.95 | 24.23 | 26.69 | 28.5 | 85.18 | 39.82 | 11.2 | 99.5 | 54.01 | 48.06 | 45.27 | |
2026.04 | 29.73 | 39.93 | 43.71 | 53.19 | 46.49 | 24.66 | 29.32 | 23.71 | 25.19 | 30.75 | 90.83 | 33.44 | 9 | 66.5 | 44.47 | 50.91 | 40.11 | |
2026.04 | 29.62 | 33.01 | 41.37 | 52.51 | 37.97 | 25.28 | 29.41 | 23.95 | 22.93 | 52 | 84.36 | 40.03 | 9.66 | 99.5 | 37.48 | 47.58 | 41.67 | |
2026.04 | 28.98 | 41.2 | 45.34 | 56.93 | 49.53 | 29.89 | 32.12 | 23.59 | 25.78 | 33 | 86.08 | 40.48 | 9.55 | 99.5 | 53.21 | 47.29 | 43.9 | |
2026.04 | 28.5 | 31.47 | 35.4 | 54.62 | 41.94 | 28.26 | 29.01 | 22.17 | 23.14 | 38 | 84.51 | 40.95 | 9.1 | 90 | 54.18 | 47.84 | 41.19 | |
2026.04 | 28.49 | 16.95 | 34.22 | 40.71 | 25.38 | 15.27 | 26.3 | 21.03 | 19.15 | 40 | 80.01 | 39.18 | 8.5 | 89 | 26.07 | 47.99 | 34.89 | |
2026.04 | 28.29 | 43.53 | 37.19 | 52.35 | 42.17 | 32.69 | 31.92 | 23.97 | 26.33 | 30.5 | 91.81 | 38.57 | 8.44 | 76 | 47.02 | 47.34 | 41.13 | |
2026.04 | 27.45 | 39.59 | 49.46 | 55.72 | 44.23 | 26.95 | 32.22 | 24.25 | 25.51 | 59 | 86.44 | 33.6 | 9.55 | 87.5 | 33.05 | 49.16 | 42.73 | |
2026.04 | 25.87 | 29.04 | 32.51 | 48.46 | 31.27 | 24.48 | 29.07 | 22.72 | 24.6 | 50.5 | 92.17 | 26.9 | 7.55 | 18 | 40.11 | 48.94 | 34.51 | |
2026.04 | 25.37 | 37.53 | 32.06 | 49.57 | 38.27 | 23.83 | 30.97 | 22.23 | 25.83 | 31 | 91.9 | 37.62 | 6.95 | 54 | 49.54 | 48.45 | 37.82 | |
2026.04 | 25.33 | 24.72 | 27.81 | 43.9 | 30.86 | 21.58 | 24.56 | 22.14 | 21.54 | 7 | 91.22 | 28.79 | 10 | 21.5 | 35.61 | 51.06 | 30.48 | |
2026.04 | 24.15 | 20.79 | 22.81 | 44.52 | 23.38 | 20.51 | 25.14 | 19.7 | 20.07 | 34.5 | 81.21 | 38.33 | 6.5 | 53.5 | 51.06 | 48.96 | 33.45 | |
2026.04 | 23.27 | 24.47 | 25.44 | 42.06 | 27.26 | 19.82 | 28.87 | 20.82 | 23.8 | 32 | 91.52 | 35.66 | 7 | 33.5 | 50.9 | 50.51 | 33.56 | |
2026.04 | 22.44 | 16.23 | 28.48 | 37.69 | 21.73 | 13.3 | 26.03 | 20.64 | 20.56 | 45.5 | 62.78 | 29.03 | 11.5 | 25 | 23.06 | 51.52 | 28.47 | |
2026.04 | 22.18 | 29.67 | 39.44 | 47.45 | 30.45 | 20.51 | 28.68 | 22.78 | 23.48 | 51.5 | 72.85 | 28.98 | 9.15 | 52.5 | 27.2 | 49.17 | 34.75 | |
2026.04 | 21.53 | 18.98 | 22.64 | 37.24 | 22.15 | 14.53 | 24.99 | 19.11 | 19.76 | 28.5 | 90.81 | 34.56 | 4 | 16 | 52.72 | 52.73 | 30.02 |