Share your thoughts, 1 month free Claude Pro on usSee more

Embodied AI on EmbodiedBench EB-Habitat

98.5Base Score

A-Mem

Updated 23d ago

Evaluation Results

Method
A-Mem 2026.05	98.5	75.5	73.17	40.6	82.11	83.17	75.5
A-Mem 2026.05	98	72	52	24	80	78	67.33
G-Mem 2026.05	93.75	73	62.36	48.32	80.19	80.65	73.04
MemCompiler 2026.05	93.25	60.5	55.5	54.33	65.31	66.33	65.7
G-Mem 2026.05	92	68	50	46	78	74	68
G-Mem 2026.05	91.33	35.5	47.5	47.85	57.5	57.92	56.27
Mem0 2026.05	91.17	31.5	34.5	38.28	56.67	48.08	50.03
Langmem 2026.05	90.85	34.5	36.5	38.95	55.17	47.41	50.56
MemCompiler 2026.05	90	58	44	38	40	64	55.67
A-Mem 2026.05	89.83	20.5	52.5	41.69	57.33	29.67	48.59
Mem0 2026.05	89.25	75	61	55.42	61.58	79.08	70.22
LangMem 2026.05	89	74	66	32.53	83	84.23	71.49
No Mem 2026.05	88.5	61	61	44.86	59.92	69.92	64.2
G-Mem 2026.05	88	24	36	34	32	50	44
MemCompiler 2026.05	86.75	62.5	59	46.93	61.57	65.41	63.69
No Mem 2026.05	86	52	46	30	30	62	51
Mem0 2026.05	86	64	48	44	30	70	57
LangMem 2026.05	86	68	56	14	74	78	62.67
A-Mem 2026.05	86	12	38	24	36	24	36.67
Langmem 2026.05	86	26	28	18	32	40	38.33
LangMem 2026.05	86	49	48.51	22.03	61.67	63.17	55.06
G-Mem 2026.05	84.5	46	43	34.95	59.08	63.67	55.2
LangMem 2026.05	84	40	40	6	34	56	43.33
MemCompiler 2026.05	84	54	56	38	36	60	54.67
Mem0 2026.05	84	24	26	20	34	42	38.33
Langmem 2026.05	83.25	39	52	32.14	55.5	46	51.31
No Mem 2026.05	82.67	35.5	42	26.97	47.83	40.42	45.89
G-Mem 2026.05	82	36	20	18	30	56	40.33
No Mem 2026.05	81.75	44.5	52	32.2	59.83	46.83	52.85
Mem0 2026.05	81	45	48	26.95	62.25	58	53.53
No Mem 2026.05	80.75	33	60	24.19	56.83	34.58	48.22
No Mem 2026.05	80	38	36	16	32	40	40.33
LoHo-Manip-4B 2026.04	78	32	46	20	28	26	38
No Mem 2026.05	78	22	52	10	30	26	36.33
No Mem 2026.05	78	26	28	14	28	34	34.67
Mem0 2026.05	76	36	30	10	30	44	37.67
Langmem 2026.05	76	28	44	16	28	40	38.67
Mem0 2026.05	74.33	42.5	58.86	33.36	57.5	45.25	51.97
GPT-4o mini 2026.04	74	22	32	14	32	22	33
Llama3.2-11B 2026.04	70	16	28	6	20	10	25
A-Mem 2026.05	70	33	35	18.12	55.83	56.67	44.77
Qwen3-VL-4B 2026.04	68	16	38	10	26	20	30
Mem0 2026.05	68	34	44	16	30	38	38.33
A-Mem 2026.05	64	30	18	6	28	48	32.33
MemGen 2026.05	60.23	19.67	30.33	15.7	26.21	40.47	32.1
InternVL3-8B 2026.04	60	14	24	10	20	18	24
MemGen 2026.05	57.91	15	25	10.17	56.17	24.33	31.43
MemGen 2026.05	54	8	18	4	24	18	21
G-Mem 2026.05	50.33	19	21.5	4.67	40.17	16.17	25.31
MemGen 2026.05	50	14	22	10	22	36	25.67
G-Mem 2026.05	38	12	8	2	20	8	14.67
A-Mem 2026.05	37.25	15.5	10	5.33	21.75	15.5	17.56
A-Mem 2026.05	24	8	6	0	4	8	8.33