Share your thoughts, 1 month free Claude Pro on usSee more

Spatial Reasoning on EmbSpatial

90.3Overall Accuracy

Human

Updated 8d ago

Evaluation Results

Method
Human 2026.05	90.3	-
Gemini 3 Pro 2026.05	84.3	-
OpenVLThinkerV2 2026.04	83.1	-
GPT-5 2026.04	82.9	-
GPT-5 2026.05	81.5	-
TIGeR 2025.10	80.82	-
OneThinker-8B 2026.04	79.9	-
Qwen3-VL GRPO 2026.04	79.9	-
Qwen3-VL GDPO 2026.04	79.9	-
ProSR 2026.05	79.8	-
GPT-3.2 2026.05	79.3	-
Gemini 2.5 Pro 2026.04	79.1	-
QWEN3-VL-8B-THINKING + GRPO 2026.05	79	-
Qwen3-VL-8B-Thinking 2026.05	78.9	-
GPT-5-mini 2026.05	78.8	-
Molmo2-ER 2026.05	78.8	-
Gemini 2.5 Pro 2026.05	78.8	-
GeoThinker 2026.05	78.8	-
Gemini-2.5-Pro-preview-05-06 2026.01	78.74	-
Gemini-2.5-pro 2025.12	78.74	-
Gemini2.5-pro 2026.03	78.7	-
QWEN3-VL-8B-THINKING + SFT 2026.05	78.6	-
RoboBrain-32B-2.0 2026.01	78.57	-
Qwen3-VL-8B-Inst. 2026.03	78.5	-
GR-ER 1.5 Thinking 2026.05	78.4	-
Qwen3-VL-8B 2025.12	78.32	-
GPT-o4-mini-2025-05-16 2026.01	78.29	-
GPT-4o-mini 2025.12	78.29	-
Qwen3-VL-Instruct 2026.04	78.2	-
Qwen3-VL-8B 2026.05	78.2	-
Qwen3-VL-4B 2026.05	78.1	-
Gemini 2.5 Pro 2026.05	78	-
Qwen3-VL-8B-Instruct 2026.05	77.7	-
GeoWeaver-5B 2026.05	77.5	-
Robix 7B Base 2025.12	77.4	-
ACE-Brain-0-8B 2026.03	77.3	-
Gemini-2.5-Pro 2025.10	76.67	-
GLM-4.1V-Thinking 2025.10	76.62	-
RoboBrain-7B-2.0 2026.01	76.32	-
RoboBrain2.0-7B 2026.03	76.3	-
MiMo-Embodied-7B 2026.03	76.2	-
RoboBrain-7B-2.0 2025.12	75.88	-
RoboBrain2.0-7B 2025.12	75.8	-
InternVL3.5-8B 2026.05	75.7	-
Lumo-1-Stage1 2025.12	75.6	-
RoboBrain2.5-8B 2026.03	75.6	-
Seed 1.6 2026.05	75.4	-
Vlaser-8B 2026.03	75.3	-
InternVL-3.5-8B 2025.12	75.11	-
Gemini-2.5-Flash-preview-04-17 2026.01	74.75	-
InternVL3.5-8B 2026.05	74.7	-
Qwen2.5-VL-32B-Instruct 2025.12	74.59	-
Qwen2.5-VL-32B-Instruct 2026.01	74.45	-
InternVL3-8B 2026.03	73.9	-
VST-7B-SFT 2026.05	73.7	-
GR-ER 1.5 2026.05	73.4	-
Qwen2.5-VL-72B-Instruct 2026.01	73.3	-
Pelican-VL-7B 2026.03	73.2	-
BAGEL-7B-MoT 2026.05	73.1	-
Cambrian-S-7B 2026.05	72.8	-
Cambrian-S-7B 2026.05	72.8	-
Action-Sketcher-3B 2026.01	72.65	-
SenseNova-SI-1.1-Qwen3-VL-8B 2026.05	72.5	-
InternVL3.5-4B 2026.05	72	-
GPT-4o-2024-11-20 2026.01	71.92	-
GPT-4o 2026.03	71.9	-
Qwen2.5-VL-7B-Instruct 2026.05	71.8	-
Lumo-1-Stage2 2025.12	71.68	-
Qwen2.5-VL-7B-Instruct 2025.12	71.26	-
GenieReasoner 2025.12	70.66	-
VeBrain-8B 2026.01	70.52	-
VeBrain-7B 2026.03	70.5	-
Qwen2.5-VL-7B 2025.12	70.47	-
InternVL3.5-8B 2026.03	70.3	-
LLaVA-OV-7B 2026.05	69.7	-
Qwen3-VL-2B-Inst. 2026.03	69.2	-
Cosmos-Reason1-7B 2025.12	68.9	-
VLM-3R-7B 2026.05	68.2	-
RoboBrain-7B-1.0 2026.01	68.13	-
NVILA-8B 2025.10	67.72	-
ViLaSR-7B 2026.05	67.3	-
Molmo2 2026.05	67	-
SpaceR-7B 2026.05	66.9	-
SpaceR-SFT-7B 2026.05	66.9	-
Cosmos-Reason1-7B 2026.01	65.22	-
Magma-8B 2026.01	64.59	-
Claude-4-Sonnet 2026.03	64.3	-
Claude-Sonnet-4 2025.12	64.29	-
Claude-Sonnet-4-2025-05-14 2026.01	64.26	-
GPT-4o 2025.10	63.38	-
G2VLM 2026.04	62.4	-
Qwen2.5-VL-3B 2025.12	62.01	-
SpatialRGPT-8B 2026.04	59.6	-
SpatialLadder-3B 2026.05	58.2	-
SpatialLadder-3B 2026.05	58.2	-
SpatialBot-3B 2025.10	50.66	-
Spatial-MLLM-4B 2026.05	50	-
SpaceLLaVA-13B 2025.10	49.4	-
SpaceLLaVA-13B 2026.04	49.4	-
RoboPoint-13B 2025.10	49.31	-

Showing 100 of 155 rows