Share your thoughts, 1 month free Claude Pro on usSee more

Task Planning on EB-Habitat Long

64Success Rate (SR)

GPT-4o

Updated 3mo ago

Evaluation Results

Method	Links
GPT-4o 2025.08		64	72.2
RoboMemory 2025.08		62	74
RoboMemory 2026.03		62	74
BrainMem 2026.03		62	75.3
Claude-3.5-Sonnet 2025.08		58	63.3
Gemini-1.5-Pro 2025.08		52	61.2
Claude-3.7-Sonnet 2025.08		46	-
InternVL3-78B 2025.08		40	-
Cradle 2025.08		30	52.1
Cradle 2026.03		30	52.1
InternVL2.5-78B 2025.08		28	38.2
InternVL2.5-38B 2025.08		28	35
Gemini-2.0-flash 2025.08		26	36.2
Voyager 2025.08		22	51
Voyager 2026.03		22	51
RoboOS 2025.08		20	28.2
RoboOS 2026.03		20	28.2
Qwen2.5-VL-72B-Ins 2025.08		18	-
Reflexion 2025.08		15	33
Reflexion 2026.03		15	33
GPT-4o-mini 2025.08		14	21.3
Llama-3.2-90B-Vision-Ins 2025.08		14	24.3
RoboOS 2025.08		12	17.4