Share your thoughts, 1 month free Claude Pro on usSee more

Task Planning on EB-ALFRED Base

96Success Rate (SR)

Claude-3.5-Sonnet

Updated 24d ago

Evaluation Results

Method	Links
Claude-3.5-Sonnet 2025.08		96	97.5
Llama-3.2-90B-Vision-Ins 2025.08		94	94.5
Gemini-1.5-Pro 2025.08		92	92.5
Claude-3.7-Sonnet 2025.08		90	-
GPT-4o 2025.08		86	90.7
RoboMemory 2025.08		86	88
InternVL3-78B 2025.08		84	-
Gemini-2.0-flash 2025.08		82	82
InternVL2.5-78B 2025.08		80	82
Reflexion 2025.08		80	84.2
Voyager 2025.08		76	87
GPT-4o-mini 2025.08		74	77.5
Qwen2.5-VL-72B-Ins 2025.08		74	-
Claude-3.5-Sonnet 2025.08		72	72
Gemini-1.5-Pro 2025.08		70	74.3
Claude-3.7-Sonnet 2025.08		68	-
RoboMemory 2025.08		68	75.5
GPT-4o 2025.08		64	74
Gemini-2.0-flash 2025.08		62	65.7
Cradle 2025.08		62	67
InternVL2.5-38B 2025.08		60	61.5
Voyager 2025.08		56	73.2
Cradle 2025.08		54	67.9
Qwen2.5-VL-72B-Ins 2025.08		50	-
Reflexion 2025.08		48	54
Llama-3.2-90B-Vision-Ins 2025.08		38	43.7
InternVL2.5-78B 2025.08		38	42.3
InternVL3-78B 2025.08		38	-
RoboOS 2025.08		38	47.8
InternVL2.5-38B 2025.08		36	37.3
GPT-4o-mini 2025.08		34	47.8
RoboOS 2025.08		32	38.4
RoboOS 2025.08		32	37.2
RoboOS 2025.08		28	34.8