Share your thoughts, 1 month free Claude Pro on usSee more

Long-term conversational question answering on LongMemEval

97.14SS User Accuracy

LightMem

Updated 26d ago

Evaluation Results

Method	Links
LightMem 2026.05		97.14	13.71	26.79	6	93.33	11.05	76.69	6.49	83.33	5.79	79.7	8.65	76.8	8.18
MemShot 2026.05		95.71	82.48	98.21	78.05	33.33	6.94	57.89	42.73	71.79	61.3	48.87	34.88	66	50.91
MemShot 2026.05		95.71	81.76	98.21	82.51	50	8.47	66.17	51.47	89.74	61.49	59.4	41.53	74.8	55.53
Text RAG 2026.05		94.29	76.08	98.21	83.62	50	10.41	64.66	48.6	73.08	51.07	62.41	38.93	72.4	51.89
EverMemOS 2026.05		94.29	26.06	89.29	25.95	90	13.55	64.66	10.64	83.33	14.61	57.89	15.98	74.2	16.73
LightMem 2026.05		92.86	12.72	25	5.06	80	9.2	68.42	6.63	70.51	5.66	67.67	8.13	67.8	7.71
EverMemOS 2026.05		92.86	30.39	67.86	27.83	56.67	10.81	60.9	11.44	74.36	17.47	49.62	15.6	65	17.94
MemoryOS 2026.05		91.43	76.27	92.86	77.75	63.33	9.75	54.14	45.54	70.51	60.37	45.11	42.33	64.4	52.76
MemOCR 2026.05		88.57	67.77	89.29	63.05	33.33	8.64	42.11	31.22	79.49	49.25	29.32	27.87	55.8	40.6
Text RAG 2026.05		87.14	72.59	94.64	79.66	30	6.51	48.87	37.13	67.95	50.35	46.62	34.29	60.6	46.33
MemOS 2026.05		85.71	22.8	94.64	25.48	56.67	11.37	47.37	6.67	80.77	7.95	51.13	7.52	64.8	11.74
MemoryOS 2026.05		85.71	75.94	85.71	69.51	53.33	9.85	29.32	30.72	56.41	54.08	30.08	32.91	49.4	44.37
MemOS 2026.05		85.71	10.24	94.64	16.69	73.33	12.86	48.12	4.76	84.62	6.73	58.65	6.27	68.6	8.06
MemOCR 2026.05		85.71	70.53	98.21	69.2	50	11.98	52.63	40.89	76.92	53.69	36.84	27.9	61.8	45.32