Long-context Question Answering on LoCoMo
57.32Average F1
QRRanker
Updated 4d ago
Evaluation Results
| Method | Links | |||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
2026.02 | 57.32 | 44.73 | - | 64.53 | - | 31.04 | - | 61.78 | - | - | - | - | - | |
2026.02 | 57.03 | 43.06 | - | 61.9 | - | 29.79 | - | 62.95 | - | - | - | - | - | |
2026.02 | 54.4 | - | - | - | - | - | - | - | - | - | - | - | - | |
2026.01 | 53.84 | - | - | - | - | - | - | - | - | - | - | 40.81 | - | |
2026.01 | 53.84 | - | - | - | - | - | - | - | - | - | - | 40.93 | - | |
2026.02 | 53.1 | 39.88 | - | 58.03 | - | 27.96 | - | 60.09 | - | - | - | - | - | |
2026.01 | 52.44 | - | - | - | - | - | - | - | - | - | - | 42.25 | - | |
2026.02 | 52.18 | 38.84 | - | 57.96 | - | 26.61 | - | 57.36 | - | - | - | - | - | |
2026.01 | 52.17 | - | - | - | - | - | - | - | - | - | - | 42.11 | - | |
2026.02 | 51.58 | 37.06 | - | 56.27 | - | 29.11 | - | 57.22 | - | - | - | - | - | |
2026.01 | 51.21 | - | - | - | - | - | - | - | - | - | - | 41.45 | - | |
2026.01 | 49.92 | - | - | - | - | - | - | - | - | - | - | 39.63 | - | |
2026.01 | 47.22 | - | - | - | - | - | - | - | - | - | - | 36.48 | - | |
2026.01 | 46.94 | - | - | - | - | - | - | - | - | - | - | 35.69 | - | |
2026.02 | 45.56 | 36.52 | - | 47.9 | - | 24.77 | - | 50.07 | - | - | - | - | - | |
2026.02 | 45.09 | 38.72 | - | 48.93 | - | 28.64 | - | 47.65 | - | - | - | - | - | |
2026.02 | 44.73 | 32.11 | - | 53.79 | - | 26.14 | - | 47.64 | - | - | - | - | - | |
2026.02 | 44.72 | 32.36 | - | 55.99 | - | 29.19 | - | 46.33 | - | - | - | - | - | |
2026.02 | 44.39 | 35.89 | 29.24 | 39.78 | 27.12 | 25.74 | 19.53 | 49.08 | 43.05 | 48.24 | 48.92 | 38.7 | - | |
2026.02 | 44.12 | 28 | 18.47 | 9.09 | 5.78 | 16.47 | 14.8 | 61.56 | 54.19 | 52.61 | 51.13 | 38.7 | - | |
2026.02 | 43.76 | 32.11 | 24.48 | 46.61 | 31.84 | 23.98 | 16.84 | 44.74 | 38.17 | 51.48 | 51.96 | 37.27 | - | |
2026.02 | 43.56 | 35.74 | - | 42 | - | 19.37 | - | 49.56 | - | - | - | - | - | |
2026.02 | 43.24 | 43.46 | - | 58.62 | - | 19.76 | - | 51.12 | - | - | - | - | - | |
2026.02 | 42.84 | 35.27 | - | 41.15 | - | 20.02 | - | 48.62 | - | - | - | - | - | |
2026.02 | 42.81 | 35.24 | - | 41.36 | - | 24.79 | - | 47.95 | - | - | - | - | - | |
2026.01 | 42.78 | - | - | - | - | - | - | - | - | - | - | 36.8 | - | |
2026.02 | 41.97 | 27.02 | 20.09 | 45.85 | 36.67 | 12.14 | 12 | 44.65 | 37.06 | 50.03 | 49.47 | 36.16 | - | |
2026.01 | 41.67 | - | - | - | - | - | - | - | - | - | - | 35.1 | - | |
2026.02 | 41.02 | 30.36 | 22.83 | 17.29 | 13.18 | 12.24 | 11.87 | 60.16 | 53.35 | 34.96 | 34.25 | 36.23 | - | |
2026.02 | 40.53 | 32.86 | 23.76 | 39.41 | 31.23 | 17.1 | 15.84 | 48.43 | 42.97 | 36.35 | 35.53 | 35.36 | - | |
2026.02 | 40.5 | 35.7 | - | 50.1 | - | 25.9 | - | 48.9 | - | - | - | - | - | |
2026.02 | 39.74 | 25.02 | 19.75 | 18.41 | 14.77 | 12.04 | 11.16 | 40.36 | 29.05 | 69.23 | 68.75 | 33.47 | - | |
2026.02 | 39.65 | 27.02 | - | 45.85 | - | 12.14 | - | 44.65 | - | - | - | - | - | |
2026.02 | 38.7 | 34.72 | 25.13 | 45.93 | 35.51 | 22.64 | 15.58 | 43.65 | 37.42 | 30.15 | 27.44 | 32.07 | - | |
2026.02 | 38.62 | 28.24 | 22.76 | 38.39 | 33.64 | 15.43 | 13.81 | 42.09 | 36.57 | 43.79 | 43.14 | 34.51 | - | |
2026.02 | 36.59 | 35.13 | 27.56 | 52.38 | 44.15 | 17.73 | 15.92 | 39.12 | 35.43 | 25.44 | 24.19 | 32.25 | - | |
2026.02 | 35.45 | 26.65 | 17.72 | 25.52 | 19.44 | 9.15 | 7.44 | 41.04 | 34.34 | 43.29 | 42.73 | 30.16 | - | |
2026.01 | 35.24 | - | - | - | - | - | - | - | - | - | - | 29.88 | - | |
2026.02 | 33.65 | 30.8 | 23.13 | 29.25 | 24.56 | 14.11 | 11.03 | 42.25 | 35.52 | 26.59 | 25.02 | 28.45 | - | |
2026.01 | 33.44 | - | - | - | - | - | - | - | - | - | - | 27.81 | - | |
2026.01 | 33.18 | - | - | - | - | - | - | - | - | - | - | 26.51 | - | |
2026.02 | 32.76 | 24.3 | 16.9 | 34.5 | 23.1 | 13.1 | 12.2 | 38.1 | 33.3 | 31 | 30.1 | 27.58 | - | |
2026.02 | 32.42 | 33.37 | 24.26 | 31.49 | 16.42 | 13.92 | 11.02 | 25.46 | 24.82 | 49.17 | 35 | 25.02 | - | |
2026.01 | 31.5 | - | - | - | - | - | - | - | - | - | - | 27.3 | - | |
2026.01 | 31.21 | - | - | - | - | - | - | - | - | - | - | 23.26 | - | |
2026.02 | 30.88 | 22.13 | 13.44 | 31.47 | 22.16 | 14.51 | 13.54 | 33.49 | 34.12 | 34.58 | 31.44 | 27.67 | - | |
2026.02 | 29.27 | 21.25 | 14.53 | 30.2 | 21.11 | 11.33 | 10.53 | 32.75 | 26.33 | 30.95 | 30.13 | 23.9 | - | |
2026.02 | 28.99 | 24.12 | 15.41 | 25.48 | 19.04 | 13.44 | 12.64 | 34.74 | 32.41 | 27.11 | 24.32 | 25.06 | - | |
2026.02 | 28.62 | 25.09 | 15.73 | 32.82 | 27.14 | 14.47 | 13.35 | 20.18 | 18.39 | 46.77 | 40.81 | 24.22 | - | |
2026.02 | 28.37 | 21.36 | 14.98 | 23.06 | 18.04 | 12.62 | 11.49 | 35.43 | 30.92 | 26.71 | 25.78 | 24.48 | - | |
2026.02 | 28.16 | 25.97 | 18.16 | 25.37 | 18.76 | 13.52 | 11.69 | 34.92 | 30.6 | 21.94 | 17.56 | 23.08 | - | |
2026.01 | 28 | - | - | - | - | - | - | - | - | - | - | 24.4 | - | |
2026.02 | 27.8 | 23.04 | 19.74 | 29.65 | 23.16 | 20.63 | 13.75 | 30.46 | 25.62 | 26.02 | 22.48 | 23.11 | - | |
2026.02 | 25.87 | 13.17 | 9.3 | 34.91 | 27.04 | 8.8 | 7.45 | 26.44 | 24.83 | 29.98 | 28.34 | 22.93 | - | |
2026.02 | 23.86 | 20.98 | 16.27 | 31.5 | 21.73 | 12.7 | 13.22 | 24.7 | 19.14 | 21.01 | 19.84 | 19.02 | - | |
2026.02 | 20.63 | 13.16 | 9.61 | 18.12 | 12.33 | 12.16 | 9.25 | 32.83 | 28.35 | 5.96 | 4.2 | 16.75 | - | |
2026.01 | 10.9 | - | - | - | - | - | - | - | - | - | - | 8.63 | - | |
2026.02 | 9.98 | 14.61 | 9.95 | 4.16 | 3.19 | 8.84 | 8.37 | 12.46 | 10.29 | 6.81 | 6.13 | 8.07 | - | |
2026.01 | 9.91 | - | - | - | - | - | - | - | - | - | - | 7.54 | - | |
2026.02 | 9.89 | 9.15 | 6.48 | 12.6 | 8.87 | 5.31 | 5.12 | 9.67 | 7.66 | 9.81 | 9.02 | 7.87 | - | |
2026.02 | 6.99 | 5 | 4.77 | 9.68 | 6.99 | 5.56 | 5.94 | 6.61 | 5.16 | 7.36 | 6.48 | 5.73 | - | |
2026.01 | 6.89 | - | - | - | - | - | - | - | - | - | - | 5.52 | - | |
2026.01 | 6.63 | - | - | - | - | - | - | - | - | - | - | 5.57 | - | |
2026.02 | 6.13 | 6.49 | 4.69 | 2.47 | 2.43 | 6.43 | 5.3 | 8.28 | 7.1 | 4.42 | 3.67 | 5.15 | - | |
2026.02 | - | 23.8 | - | 33.5 | - | 14 | - | 37.3 | - | - | - | - | -33 | |
2026.02 | - | 4.6 | - | 1.3 | - | 10.8 | - | 5.6 | - | - | - | - | -5.2 | |
2026.02 | - | 23.1 | - | 29.1 | - | 13.3 | - | 37.7 | - | - | - | - | -31.8 | |
2026.02 | - | 4.5 | - | 1.3 | - | 9.3 | - | 5.2 | - | - | - | - | -5.4 | |
2026.02 | - | 25.2 | - | 34.1 | - | 14.1 | - | 41.6 | - | - | - | - | -28.7 | |
2026.02 | - | 8.4 | - | 4.3 | - | 10.6 | - | 6.8 | - | - | - | - | -5.9 | |
2026.02 | - | 22.6 | - | 13.9 | - | 6.7 | - | 41.2 | - | - | - | - | -25.4 | |
2026.02 | - | 3.7 | - | 1.6 | - | 9.5 | - | 3.8 | - | - | - | - | -3.2 | |
2026.02 | - | 24.3 | - | 17.2 | - | 7.9 | - | 41.5 | - | - | - | - | -24.3 | |
2026.02 | - | 6.4 | - | 1.6 | - | 6.7 | - | 6.3 | - | - | - | - | -5.6 | |
2026.02 | - | 28.1 | - | 18.1 | - | 7.1 | - | 47.6 | - | - | - | - | -19.8 | |
2026.02 | - | 9.1 | - | 5.5 | - | 8.7 | - | 8.2 | - | - | - | - | -7.6 |