Long-context Question Answering on LongBench
59.71HotPotQA Accuracy
Full Attention
Updated 7d ago
Evaluation Results
| Method | Links | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|
2025.10 | 59.71 | - | - | - | 64.93 | - | 54.36 | - | - | |
2025.10 | 55.95 | - | 29.17 | 47.79 | 54.46 | 41.33 | 46.27 | 30.57 | 25.1 | |
2025.10 | 55.75 | - | 29.25 | 46.87 | 54.25 | 41.24 | 46.51 | 31.07 | 24.98 | |
2025.10 | 55.74 | - | - | - | 61.37 | - | 46.04 | - | - | |
2025.10 | 55.59 | - | 31.34 | 43.05 | 53.21 | 40.04 | 44.33 | 27.58 | 25.15 | |
2025.10 | 52.57 | - | 27.15 | 43.96 | 53.79 | 38.64 | 45.5 | 23.13 | 24.38 | |
2025.10 | 52.12 | - | - | - | 62.43 | - | 41.4 | - | - | |
2025.10 | 51.98 | - | 30.01 | 44.48 | 52.95 | 39.35 | 47.28 | 23.29 | 25.45 | |
2026.04 | 49.35 | 85.72 | 19.06 | 18.25 | 49.49 | 44.37 | - | - | - | |
2026.04 | 47.84 | 85.93 | 18.44 | 14.7 | 48.43 | 43.07 | - | - | - | |
2026.04 | 47.77 | 83.29 | 17.37 | 14.12 | 49.9 | 42.49 | - | - | - | |
2026.04 | 45.68 | 83.16 | 15.65 | 13.17 | 48.33 | 41.2 | - | - | - | |
2025.10 | 45.29 | - | - | - | 59.7 | - | 38.34 | - | - | |
2025.10 | 44.63 | - | - | - | 49.44 | - | 37.7 | - | - | |
2025.10 | 44.11 | - | - | - | 57.34 | - | 41.08 | - | - | |
2026.04 | 43.36 | 80.32 | 18.69 | 15.63 | 46.74 | 40.95 | - | - | - | |
2026.04 | 32.59 | 80.92 | 11 | 19.28 | 42.3 | 37.22 | - | - | - | |
2026.04 | 32.57 | 78.36 | 8.73 | 18.21 | 43.2 | 36.21 | - | - | - | |
2026.04 | 32.5 | 78.43 | 9.8 | 19.36 | 43.08 | 36.63 | - | - | - | |
2026.04 | 27.31 | 70.4 | 6.44 | 17.29 | 41.4 | 32.57 | - | - | - |