Long-term conversational memory on LoCoMo
79.44Overall Acc (LoCoMo)
RAG (Dense)
Updated 1mo ago
Evaluation Results
| Method | Links | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|
2026.05 | 79.44 | - | - | - | - | - | 61.8 | 17.06 | 0.075 | |
2026.05 | 79.1 | 58.33 | 77.57 | 84.54 | 75.89 | 76.46 | - | - | - | |
2026.05 | 77.69 | - | - | - | - | - | 61 | 17.19 | 0.08 | |
2026.05 | 77.29 | 59.38 | 78.01 | 83.12 | 70.92 | 75.11 | - | - | - | |
2026.05 | 76.1 | - | - | - | - | - | 58.4 | 13 | 0.065 | |
2026.05 | 75.8 | 67.49 | 75.18 | 55.9 | 81.09 | - | - | - | - | |
2026.05 | 75.78 | 51.04 | 62.93 | 76.58 | 73.76 | 90.13 | - | - | - | |
2026.05 | 75.53 | 48.96 | 64.8 | 75.98 | 73.4 | 89.46 | - | - | - | |
2025.10 | 74.8 | 70.49 | 79.29 | 68.48 | 79.52 | 76.24 | - | - | - | |
2026.05 | 74.58 | - | - | - | - | - | 57.1 | 7.72 | 0.029 | |
2025.10 | 74.02 | 74.08 | 91.6 | 64.35 | 86.08 | 54.01 | - | - | - | |
2026.05 | 73.9 | 54.7 | 66.7 | 49.7 | 79.7 | 83.9 | - | - | - | |
2026.05 | 72.01 | 64.65 | 81.2 | 53.12 | 73.12 | - | - | - | - | |
2025.10 | 71.97 | 69.75 | 79.23 | 61.2 | 78.44 | 71.25 | - | - | - | |
2026.05 | 70 | 52.8 | 65 | 51.7 | 77.6 | 74.2 | - | - | - | |
2026.05 | 68.44 | 47.19 | 58.13 | 75.71 | 65.71 | - | - | - | - | |
2026.05 | 68.22 | - | - | - | - | - | 50.8 | 6.29 | 0.024 | |
2026.05 | 66.86 | - | - | - | - | - | 54.2 | - | - | |
2026.05 | 65.95 | - | - | - | - | - | 50.1 | 2.53 | 0.004 | |
2026.05 | 65.82 | - | - | - | - | - | 51 | 10.31 | 0.054 | |
2026.05 | 65.3 | - | - | - | - | - | 51.9 | 14.2 | 0.078 | |
2026.05 | 65.05 | - | - | - | - | - | 52.3 | 23.28 | 0.145 | |
2026.05 | 64.57 | 58.75 | 52.34 | 45.83 | 73.33 | - | - | - | - | |
2026.05 | 64.5 | - | - | - | - | - | 50.9 | 6.59 | 0.033 | |
2026.05 | 64.33 | 54.26 | 68.54 | 46.88 | 68.22 | - | - | - | - | |
2025.10 | 64.33 | 62.41 | 65.57 | 73.79 | 77.64 | 42.26 | - | - | - | |
2025.10 | 64.21 | 62.46 | 73.78 | 60.87 | 78.04 | 45.91 | - | - | - | |
2026.05 | 63.42 | - | - | - | - | - | 50.5 | - | - | |
2026.05 | 63.36 | - | - | - | - | - | 46.8 | 3.83 | 0.018 | |
2026.05 | 63.23 | - | - | - | - | - | 52.1 | 7.33 | 0.042 | |
2026.05 | 63.1 | - | - | - | - | - | 51.9 | - | - | |
2026.05 | 62.91 | - | - | - | - | - | 46.3 | 0.97 | 0.006 | |
2026.05 | 62.39 | - | - | - | - | - | 54.3 | - | - | |
2026.05 | 61.93 | - | - | - | - | - | 48.4 | - | - | |
2026.05 | 61.93 | - | - | - | - | - | 46.9 | - | - | |
2025.10 | 61.53 | 52.5 | 76.03 | 52.83 | 63.44 | 62.87 | - | - | - | |
2026.05 | 60.51 | - | - | - | - | - | 53 | - | - | |
2026.05 | 60.51 | - | - | - | - | - | 46.8 | 15.89 | 0.081 | |
2026.05 | 59.62 | 45.83 | 44.24 | 64.8 | 58.87 | 64.35 | - | - | - | |
2026.05 | 59.53 | - | - | - | - | - | 45 | - | - | |
2026.05 | 59.22 | 52.12 | 54.82 | 33.33 | 66.23 | - | - | - | - | |
2026.05 | 59.08 | - | - | - | - | - | 45.7 | 14.66 | 0.071 | |
2026.05 | 59 | 56.9 | 64.9 | 48.5 | 76.4 | 32.5 | - | - | - | |
2026.05 | 58 | 49.5 | 47.4 | 38.5 | 65.3 | 61.6 | - | - | - | |
2026.05 | 57.91 | - | - | - | - | - | 47.6 | - | - | |
2026.05 | 56.34 | 38.54 | 23.68 | 62.78 | 60.64 | 68.83 | - | - | - | |
2026.05 | 55.9 | - | - | - | - | - | 47.8 | - | - | |
2026.05 | 55.51 | - | - | - | - | - | 45.6 | - | - | |
2026.05 | 55.34 | 51.12 | 31.77 | 42.67 | 67.3 | - | - | - | - | |
2026.05 | 55.3 | 55.2 | 42.2 | 50.4 | 67.4 | 42.8 | - | - | - | |
2026.05 | 54.8 | 31.5 | 45.7 | 33.5 | 65.7 | 60.3 | - | - | - | |
2026.05 | 54.6 | - | - | - | - | - | 41.4 | 12.19 | 0.082 | |
2026.05 | 51.1 | - | - | - | - | - | 44.1 | - | - | |
2026.05 | 50.1 | 48 | 45.3 | 49.8 | 61.4 | 31.7 | - | - | - | |
2026.05 | 49.9 | 30.1 | 40.2 | 33.4 | 57.6 | 58.9 | - | - | - | |
2026.05 | 48.1 | 46.8 | 56.2 | 48.6 | 63 | 20.5 | - | - | - | |
2026.05 | 44.62 | - | - | - | - | - | 38.8 | - | - | |
2026.05 | 44.42 | - | - | - | - | - | 38.6 | - | - | |
2026.05 | 42.41 | - | - | - | - | - | 33.2 | - | - | |
2026.05 | 41.76 | - | - | - | - | - | 37.8 | - | - | |
2026.05 | 41.2 | 31.7 | 45 | 37.9 | 64.1 | 3.6 | - | - | - | |
2026.05 | 41 | 25.8 | 20.3 | 21.9 | 41.6 | 68.4 | - | - | - | |
2026.05 | 28 | 28.5 | 21.2 | 19.4 | 34.1 | 22.9 | - | - | - | |
2026.05 | 21.5 | 22.9 | 9.5 | 33.5 | 22.7 | 24.4 | - | - | - | |
2026.05 | 17.9 | 14.9 | 7.9 | 15.8 | 18.7 | 26.6 | - | - | - |