SOTA Embodied Visual Question Answering on ERQA and PapersWithCode

59Accuracy

GPT-5

Updated 1mo ago

Evaluation Results

Method	Links
GPT-5 2026.05		59
GPT-5-mini 2026.05		57.3
Gemini 2.5 Pro 2026.05		56
Gemini-2.5-Pro 2026.06		55.7
GR-ER 1.5 Thinking 2026.05		54.8
Qwen3-VL-32B-Instruct + SpatialBoost 2026.03		51.5
GPT-5.4 2026.06		50.5
InternVL3-38B + SpatialBoost 2026.03		49.3
Qwen3-VL-32B-Instruct 2026.03		48.8
Gemini-Robotics-ER-1.5 2026.06		48.5
GR-ER 1.5 2026.05		47
Molmo2-ER 2026.05		46.8
Mimo-Embodied 2026.06		46.8
Molmo2 2026.05		46.3
Embodied-R1.5 2026.06		46
Qwen3-VL-8B 2026.06		43.5
Ours-8B 2026.06		43.5
InternVL3-38B 2026.03		42.8
Qwen3-VL-8B 2026.06		41.8
Qwen3-VL-8B 2026.05		41.5
InternVL3.5-8B 2026.05		41
InternVL3.5-8B 2026.06		41
Molmo-D-7B 2026.06		40.6
InternVLA-M1 2026.06		40.35
GR3D-8B 2026.05		40.25
LLaVA-OV-7B 2026.05		39.8
Pelican-VL-1.0 2026.06		39.8
Qwen3-VL-4B 2026.05		39.5
Embodied-R1-7B 2026.06		39.1
GR3D-8B 2026.05		38.5
RoboBrain-2.0-7B 2026.06		38.5
VeBrain 2026.06		37.3
InternVL3.5-4B 2026.05		37
NVILA-Lite-8B 2026.05		36.25
Embodied-R1 2026.06		35.2
RoboBrain2.0-7B 2026.06		34.25
GPT-4o 2026.06		32.5
InternVL3-8B 2026.06		32.08
Magma 2026.06		25.4