Share your thoughts, 1 month free Claude Pro on usSee more

Memory Agent Performance on MemoryAgentBench

38.85Average Performance

δ-Mem (MSW)

Updated 1d ago

Evaluation Results

Method	Links
δ-Mem (MSW) 2026.05		38.85	44.4	47.29	41.55	17
δ-Mem 2026.05		38.85	44.4	47.29	41.55	17
δ-Mem (MSW) 2026.06		38.85	44.4	47.29	41.55	17
δ-Mem (SSW) 2026.05		37.84	41.5	50.5	43.02	16.5
δ-Mem 2026.05		37.84	41.5	50.5	43.02	16.5
δ-Mem (SSW) 2026.06		37.84	41.5	50.5	43.02	16.5
δ-Mem (TSW) 2026.05		36.48	42.45	40.64	46.08	15.88
δ-Mem 2026.05		36.48	42.45	40.64	46.08	15.88
δ-Mem (TSW) 2026.06		36.48	42.45	40.64	46.08	15.88
δ-Mem 2026.05		33.63	45.55	19.52	46.11	13.5
δ-Mem 2026.05		32.97	45.65	16.43	46.41	12.88
δ-Mem 2026.05		32.66	45.55	14.95	44.6	13.38
Context2LoRA 2026.05		32.53	40	29.86	25.15	17.75
Context2LoRA 2026.05		32.53	40	29.86	25.15	17.75
Context2LoRA 2026.06		32.53	40	29.86	25.15	17.75
Qwen3-8B 2026.05		31.87	45.1	12.79	48.22	12
Context2LoRA 2026.05		30.52	43.15	10.05	34.04	16.13
MemGen 2026.05		29.61	34.85	28.45	44.3	14.38
MemGen 2026.06		29.61	34.85	28.45	44.3	14.38
Qwen3-4B-Instruct 2026.05		29.54	35.3	26.14	47.08	14.37
Qwen3-4B-Instruct 2026.05		29.54	35.3	26.14	47.08	14.37
Qwen3-4B-Instruct 2026.06		29.54	35.3	26.14	47.08	14.37
MLP Memory 2026.05		28.8	35.35	26	31.19	14.38
MLP Memory 2026.06		28.8	35.35	26	31.19	14.38
BM25 RAG 2026.05		24.49	32.2	9.74	37.86	15
BM25 RAG 2026.06		24.49	32.2	9.74	37.86	15
δ-Mem 2026.05		20.74	17.98	8.71	41.63	15.75
δ-Mem 2026.05		20.54	18.1	8.32	39.63	16.12
δ-Mem 2026.05		19.22	16.8	6.5	37.84	15.75
MemoryBank 2026.05		17.65	22.65	7.67	36.36	9.88
MemoryBank 2026.06		17.65	22.65	7.67	36.36	9.88
Context2LoRA 2026.05		17.62	16.08	2.86	36.77	14.75
LLMLingua-2 2026.05		15.63	21.45	1.43	38.45	8.62
LLMLingua-2 2026.06		15.63	21.45	1.43	38.45	8.62
SmolLM3-3B 2026.05		14.21	12.57	5.53	30.72	8