Share your thoughts, 1 month free Claude Pro on usSee more

Embodied Question Answering on OpenEQA

69.3Accuracy

GPT-5.4

Updated 1mo ago

Evaluation Results

Method	Links
GPT-5.4 2026.06		69.3	-
Gemini-2.5-Pro 2026.06		65.8	-
Qwen3-VL-8B 2026.06		65.1	-
GPT-5 2026.05		64.4	-
Embodied-R1.5 2026.06		62.6	-
GPT-5-mini 2026.05		59.2	-
GR-ER 1.5 Thinking 2026.05		55	-
Gemini 2.5 Pro 2026.05		55	-
Pelican-VL-1.0 2026.06		54.7	-
Mimo-Embodied 2026.06		53.6	-
GPT-4o 2026.06		51.1	-
GR-ER 1.5 2026.05		50.5	-
Gemini-Robotics-ER-1.5 2026.06		50.5	-
Qwen3-VL-8B 2026.05		49.3	-
Qwen3-VL-4B 2026.05		47.6	-
Molmo2 2026.05		46.9	-
Molmo2-ER 2026.05		44.7	-
InternVL3.5-4B 2026.05		44.6	-
InternVL3.5-8B 2026.05		43.5	-
InternVL3.5-8B 2026.06		42.9	-
LLaVA-OV-7B 2026.05		36.2	-
Molmo-D-7B 2026.06		35.1	-
Embodied-R1 2026.06		34.5	-
Magma 2026.06		32.7	-
VeBrain 2026.06		27.8	-
RoboBrain-2.0-7B 2026.06		24.2	-
InternVL2.5-8B 2026.01		-	54.4
InternVL3-8B 2026.01		-	55.5
NVILA-8B 2026.01		-	54
Qwen2.5-VL-7B 2026.01		-	50.8
Magma-8B 2026.01		-	49.1
RoboBrain2.0-7B 2026.01		-	51.1
ThinkAct-7B 2026.01		-	56.2
Fast-ThinkAct-7B 2026.01		-	59
GPT-4o 2026.03		-	56.4
Qwen2.5-VL-7B-Inst. 2026.03		-	59.9
InternVL3-8B 2026.03		-	68.3
InternVL3.5-8B 2026.03		-	64.9
Qwen3-VL-2B-Inst. 2026.03		-	56.4
Qwen3-VL-8B-Inst. 2026.03		-	67.1
RoboBrain2.0-7B 2026.03		-	60
RoboBrain2.5-8B 2026.03		-	62.6
VeBrain-7B 2026.03		-	63.8
Pelican-VL-7B 2026.03		-	63.3
MiMo-Embodied-7B 2026.03		-	74.1
Vlaser-8B 2026.03		-	56.3
ACE-Brain-0-8B 2026.03		-	70