Long-context Reasoning on LoCoMo
44.94Average F1
MemOS
Updated 4d ago
Evaluation Results
| Method | Links | |||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
2026.01 | 44.94 | 33.88 | 25.91 | 55.41 | 47.77 | 28.14 | 21.09 | 46.57 | 39.43 | - | - | 37.55 | - | - | - | - | - | - | - | |
2026.03 | 44.65 | 37.7 | 32.08 | 55.9 | 42.37 | 25.87 | 21.7 | 44.84 | 40.02 | - | - | 37.92 | - | - | - | - | - | - | - | |
2026.01 | 44.18 | 34.69 | 25.82 | 43.42 | 34.92 | 24.77 | 17.43 | 49.86 | 41.17 | - | - | 35.58 | - | - | - | - | - | - | - | |
2026.04 | 43.14 | 35.88 | 27.96 | 51.96 | 42.26 | 28.12 | 24.51 | 56.58 | 51.18 | - | - | 36.48 | - | - | - | - | - | - | - | |
2026.03 | 41.84 | 35.18 | 26.32 | 51.49 | 37.06 | 25.82 | 21.46 | 42.21 | 36.43 | - | - | 33.78 | - | - | - | - | - | - | - | |
2026.03 | 41.76 | 36.45 | 28.53 | 42.57 | 35.91 | 28.8 | 23.13 | 44.82 | 38.25 | - | - | 35.1 | - | - | - | - | - | - | - | |
2026.04 | 40.38 | 33.32 | 25.38 | 50.25 | 39.33 | 20.4 | 18.5 | 57.55 | 50.99 | - | - | 33.55 | - | - | - | - | - | - | - | |
2026.04 | 40 | 35.32 | 25.77 | 48.97 | 39.68 | 21.14 | 17.89 | 54.58 | 48.62 | - | - | 32.99 | - | - | - | - | - | - | - | |
2026.02 | 38.62 | 28.24 | 22.76 | 38.39 | 33.64 | 15.43 | 13.81 | 42.09 | 36.57 | 43.79 | 43.14 | 34.51 | - | - | - | - | - | - | - | |
2026.03 | 38.16 | 35.19 | 26.55 | 34.38 | 29.07 | 20.88 | 15.57 | 42.66 | 36.9 | - | - | 32.04 | - | - | - | - | - | - | - | |
2026.03 | 37.08 | 30.6 | 22.5 | 39.6 | 33.57 | 24.21 | 17.28 | 39.69 | 30.6 | - | - | 30.51 | - | - | - | - | - | - | - | |
2026.04 | 36.27 | 28.74 | 22.35 | 46.12 | 37.24 | 21.18 | 18.33 | 49.02 | 42.18 | - | - | 30.02 | - | - | - | - | - | - | - | |
2026.01 | 34.71 | 35.75 | 25.65 | 15.72 | 12.25 | 25.21 | 18.85 | 42.38 | 35.83 | - | - | 28.16 | - | - | - | - | - | - | - | |
2026.01 | 34.05 | 35.19 | 25.86 | 13.02 | 9.86 | 24.3 | 17.15 | 42.8 | 35.96 | - | - | 27.5 | - | - | - | - | - | - | - | |
2026.02 | 33.65 | 30.8 | 23.13 | 29.25 | 24.56 | 14.11 | 11.03 | 42.25 | 35.52 | 26.59 | 25.02 | 28.45 | - | - | - | - | - | - | - | |
2026.03 | 33.48 | 24.57 | 17.28 | 39.96 | 34.02 | 20.43 | 14.04 | 35.46 | 30.06 | - | - | 27.63 | - | - | - | - | - | - | - | |
2026.02 | 32.76 | 24.3 | 16.9 | 34.5 | 23.1 | 13.1 | 12.2 | 38.1 | 33.3 | 31 | 30.1 | 27.58 | - | - | - | - | - | - | - | |
2026.02 | 32.42 | 33.37 | 24.26 | 31.49 | 16.42 | 13.92 | 11.02 | 25.46 | 24.82 | 49.17 | 35 | 25.02 | - | - | - | - | - | - | - | |
2026.03 | 32.4 | 26.73 | 17.91 | 20.97 | 17.55 | 21.24 | 16.92 | 39.96 | 35.1 | - | - | 27.09 | - | - | - | - | - | - | - | |
2026.03 | 32.31 | 30.24 | 21.6 | 28.89 | 23.67 | 26.55 | 21.24 | 35.01 | 29.88 | - | - | 26.55 | - | - | - | - | - | - | - | |
2026.02 | 30.88 | 22.13 | 13.44 | 31.47 | 22.16 | 14.51 | 13.54 | 33.49 | 34.12 | 34.58 | 31.44 | 27.67 | - | - | - | - | - | - | - | |
2026.01 | 29.95 | 35.69 | 30.65 | 11.32 | 10.11 | 32.63 | 26.46 | 21.75 | 15.88 | - | - | 24.38 | - | - | - | - | - | - | - | |
2026.01 | 29.43 | - | - | - | - | - | - | - | - | - | - | - | 85.9 | 0.45 | - | - | - | - | - | |
2026.02 | 29.27 | 21.25 | 14.53 | 30.2 | 21.11 | 11.33 | 10.53 | 32.75 | 26.33 | 30.95 | 30.13 | 23.9 | - | - | - | - | - | - | - | |
2026.02 | 28.99 | 24.12 | 15.41 | 25.48 | 19.04 | 13.44 | 12.64 | 34.74 | 32.41 | 27.11 | 24.32 | 25.06 | - | - | - | - | - | - | - | |
2026.02 | 28.62 | 25.09 | 15.73 | 32.82 | 27.14 | 14.47 | 13.35 | 20.18 | 18.39 | 46.77 | 40.81 | 24.22 | - | - | - | - | - | - | - | |
2026.02 | 28.37 | 21.36 | 14.98 | 23.06 | 18.04 | 12.62 | 11.49 | 35.43 | 30.92 | 26.71 | 25.78 | 24.48 | - | - | - | - | - | - | - | |
2026.01 | 28.37 | - | - | - | - | - | - | - | - | - | - | - | 83.6 | 0 | - | - | - | - | - | |
2026.02 | 28.16 | 25.97 | 18.16 | 25.37 | 18.76 | 13.52 | 11.69 | 34.92 | 30.6 | 21.94 | 17.56 | 23.08 | - | - | - | - | - | - | - | |
2026.02 | 27.8 | 23.04 | 19.74 | 29.65 | 23.16 | 20.63 | 13.75 | 30.46 | 25.62 | 26.02 | 22.48 | 23.11 | - | - | - | - | - | - | - | |
2026.03 | 26.37 | 11.16 | 11.07 | 42.3 | 33.75 | 30.69 | 25.38 | 24.84 | 18.54 | - | - | 20.7 | - | - | - | - | - | - | - | |
2026.02 | 25.87 | 13.17 | 9.3 | 34.91 | 27.04 | 8.8 | 7.45 | 26.44 | 24.83 | 29.98 | 28.34 | 22.93 | - | - | - | - | - | - | - | |
2026.01 | 25.75 | - | - | - | - | - | - | - | - | - | - | - | 81.2 | 0 | - | - | - | - | - | |
2026.03 | 25.74 | 10.89 | 10.8 | 41.31 | 33.03 | 29.97 | 24.84 | 24.3 | 18.09 | - | - | 22.95 | - | - | - | - | - | - | - | |
2026.04 | 24.44 | 29.4 | 18.2 | 6 | 5.01 | 16.87 | 13.65 | 30.68 | 24.38 | - | - | 18.54 | - | - | - | - | - | - | - | |
2026.04 | 24.2 | 25.1 | 12.92 | 8.44 | 6 | 15.32 | 11.53 | 30.93 | 24.52 | - | - | 17.72 | - | - | - | - | - | - | - | |
2026.02 | 23.86 | 20.98 | 16.27 | 31.5 | 21.73 | 12.7 | 13.22 | 24.7 | 19.14 | 21.01 | 19.84 | 19.02 | - | - | - | - | - | - | - | |
2026.03 | 22.5 | 10.35 | 10.26 | 30.06 | 24.03 | 28.35 | 23.49 | 22.95 | 17.1 | - | - | 17.64 | - | - | - | - | - | - | - | |
2026.03 | 21.96 | 10.08 | 9.99 | 29.34 | 23.49 | 27.72 | 22.95 | 22.41 | 16.74 | - | - | 17.28 | - | - | - | - | - | - | - | |
2026.01 | 21.16 | 35.11 | 30.16 | 8.24 | 7.53 | 19.81 | 12.1 | 13.7 | 10.48 | - | - | 15.28 | - | - | - | - | - | - | - | |
2026.02 | 20.63 | 13.16 | 9.61 | 18.12 | 12.33 | 12.16 | 9.25 | 32.83 | 28.35 | 5.96 | 4.2 | 16.75 | - | - | - | - | - | - | - | |
2026.04 | 19.34 | 21.32 | 12.3 | 5.51 | 5.25 | 15.1 | 12.4 | 24.44 | 19.49 | - | - | 14.77 | - | - | - | - | - | - | - | |
2026.04 | 12.58 | 13.99 | 7.83 | 3.72 | 2.69 | 20.1 | 17.74 | 14.63 | 11.67 | - | - | 9.47 | - | - | - | - | - | - | - | |
2026.01 | 9.46 | - | - | - | - | - | - | - | - | - | - | - | 82.9 | 0.15 | - | - | - | - | - | |
2026.01 | 5.17 | - | - | - | - | - | - | - | - | - | - | - | 78.9 | 0 | - | - | - | - | - | |
2026.02 | - | - | - | - | - | - | - | - | - | - | - | - | - | - | 46.81 | 27.41 | 48.96 | 76.93 | 59.35 | |
2026.02 | - | - | - | - | - | - | - | - | - | - | - | - | - | - | 45.04 | 24.61 | 41.67 | 73.48 | 56.1 | |
2026.02 | - | - | - | - | - | - | - | - | - | - | - | - | - | - | 20.57 | 6.23 | 34.38 | 32.1 | 24.74 | |
2026.02 | - | - | - | - | - | - | - | - | - | - | - | - | - | - | 17.38 | 3.43 | 23.96 | 15.1 | 13.64 | |
2026.02 | - | - | - | - | - | - | - | - | - | - | - | - | - | - | 9.93 | 1.87 | 27.08 | 10.34 | 9.55 | |
2026.02 | - | - | - | - | - | - | - | - | - | - | - | - | - | - | 11.35 | 1.87 | 25 | 10.11 | 9.55 | |
2026.02 | - | - | - | - | - | - | - | - | - | - | - | - | - | - | 12.06 | 1.56 | 30.21 | 8.32 | 8.96 | |
2026.02 | - | - | - | - | - | - | - | - | - | - | - | - | - | - | 36.88 | 23.99 | 33.33 | 80.38 | 57.73 | |
2026.02 | - | - | - | - | - | - | - | - | - | - | - | - | - | - | 34.75 | 16.82 | 42.71 | 74.67 | 53.31 | |
2026.02 | - | - | - | - | - | - | - | - | - | - | - | - | - | - | 30.14 | 17.13 | 36.46 | 72.06 | 50.71 | |
2026.02 | - | - | - | - | - | - | - | - | - | - | - | - | - | - | 42.55 | 27.73 | 40.62 | 85.49 | 62.79 | |
2026.02 | - | - | - | - | - | - | - | - | - | - | - | - | - | - | 46.81 | 27.73 | 48.96 | 76.81 | 59.35 | |
2026.02 | - | - | - | - | - | - | - | - | - | - | - | - | - | - | 48.23 | 38.01 | 46.88 | 85.14 | 66.17 |