Share your thoughts, 1 month free Claude Pro on usSee more

Spatial Reasoning on 3DSRBench

95.7Overall Accuracy

Human

Updated 8d ago

Evaluation Results

Method
Human 2026.05	95.7	-	-	-	-	-	-	-	-	-	-	-	-
SPATIO 2026.04	72.4	75.2	65.8	87.3	76.5	59.4	49.9	63.7	76.1	36.8	44.6	81.5	77.2
Gemini 3 Pro 2026.05	68.9	-	-	-	-	-	-	-	-	-	-	-	-
Gpt-5.2 2026.04	67.2	68.6	68.7	81.3	74.3	51	74.3	63.4	82.6	38.5	49.3	78.2	59.6
SpatialMAS 2026.04	67.1	73.8	64.2	84.9	74.9	58.7	48.6	62.5	74.3	35.9	43.5	79.6	75.3
Claude opus 4.6 2026.04	63.5	73.8	63.1	77.4	78.3	53	72.3	55.4	78.3	42.2	48.2	60.7	59
ProSR 2026.05	62.4	-	-	-	-	-	-	-	-	-	-	-	-
GPT-3.2 2026.05	60.2	-	-	-	-	-	-	-	-	-	-	-	-
Gemini 2.5 Pro 2026.05	59.3	-	-	-	-	-	-	-	-	-	-	-	-
Qwen-3.0-VL-4B 2026.04	59.2	67.2	57.8	81.7	65.1	49.3	62.7	51.2	55.8	28.6	39.7	72.6	50.7
Qwen-3.0-VL-4B 2026.04	59.1	62.4	59.1	79.9	65.7	50.1	62.4	54.4	59.3	28.3	38.2	78.2	46.9
QWEN3-VL-8B-THINKING + GRPO 2026.05	59.1	-	-	-	-	-	-	-	-	-	-	-	-
Nash 2026.05	59.02	-	-	-	-	-	-	-	-	-	-	-	-
GeoWeaver-5B 2026.05	58.6	-	-	-	-	-	-	-	-	-	-	-	-
QWEN3-VL-8B-THINKING + SFT 2026.05	57.3	-	-	-	-	-	-	-	-	-	-	-	-
Seed 1.6 2026.05	56.9	-	-	-	-	-	-	-	-	-	-	-	-
Base 2026.05	56.12	-	-	-	-	-	-	-	-	-	-	-	-
Qwen3-VL-8B-Thinking 2026.05	55.2	-	-	-	-	-	-	-	-	-	-	-	-
SpatialReasoner 2026.04	54.3	69.4	54.3	71.5	50.3	53.3	51.7	45	49.4	30.2	33.6	68.5	54
Qwen3-VL-8B-Instruct 2026.05	53.9	-	-	-	-	-	-	-	-	-	-	-	-
SenseNova-SI-1.1-Qwen3-VL-8B 2026.05	53.2	-	-	-	-	-	-	-	-	-	-	-	-
VST-7B-SFT 2026.05	53.1	-	-	-	-	-	-	-	-	-	-	-	-
LLaVA Critic 2026.05	52.71	-	-	-	-	-	-	-	-	-	-	-	-
SpatialReasoner 2026.04	52.4	69.4	51.3	73	57.1	49.3	50.3	47.4	51.2	29.4	31.8	69.4	48.3
GeoThinker 2026.05	51.9	-	-	-	-	-	-	-	-	-	-	-	-
VLM-3R-7B 2026.05	51.5	-	-	-	-	-	-	-	-	-	-	-	-
Sa2VA 2026.04	50.5	58.2	48.6	52.2	59.4	50.1	58.7	51.2	54.1	27.1	28.6	57.5	51.9
BAGEL-7B-MoT 2026.05	50.2	-	-	-	-	-	-	-	-	-	-	-	-
Llava-4D 2026.04	49.7	59	57.5	57.7	50.9	49.9	35.6	50.3	52.3	26	27.1	54.3	51.3
InternVL3.5-8B 2026.05	49.2	-	-	-	-	-	-	-	-	-	-	-	-
Llava-4D 2026.04	49.1	51.9	48.7	58.1	58.9	50.1	44.2	50.6	56.1	20.4	24.8	57.5	56.3
Sa2VA 2026.04	48.5	59.4	43.2	46.5	48	50.1	62.4	48	48.8	23.6	26.8	59.3	61.9
Datology 2026.05	48	-	-	-	-	-	-	-	-	-	-	-	-
Qwen2.5-VL-7B-Instruct 2026.05	47.5	-	-	-	-	-	-	-	-	-	-	-	-
Qwen3.5-VL 2026.05	47	-	-	-	-	-	-	-	-	-	-	-	-
ViLaSR-7B 2026.05	46.6	-	-	-	-	-	-	-	-	-	-	-	-
Qwen3-VL 2026.05	46.5	-	-	-	-	-	-	-	-	-	-	-	-
Datology 2026.05	45.9	-	-	-	-	-	-	-	-	-	-	-	-
Qwen3.5-VL 2026.05	45	-	-	-	-	-	-	-	-	-	-	-	-
Cambrian-S-7B 2026.05	45	-	-	-	-	-	-	-	-	-	-	-	-
Cambrian-S-7B 2026.05	45	-	-	-	-	-	-	-	-	-	-	-	-
Qwen3-VL 2026.05	43.2	-	-	-	-	-	-	-	-	-	-	-	-
InternVL3.5 2026.05	43	-	-	-	-	-	-	-	-	-	-	-	-
Datology 2026.05	42.8	-	-	-	-	-	-	-	-	-	-	-	-
SpatialLadder-3B 2026.05	42.8	-	-	-	-	-	-	-	-	-	-	-	-
SpatialLadder-3B 2026.05	42.8	-	-	-	-	-	-	-	-	-	-	-	-
SpatialRGPT 2026.04	42.7	37.4	42.3	49.5	34.5	44	56.6	44.4	55	24.5	27.1	51.2	45.6
MAmmoTH-VL 2026.05	42	-	-	-	-	-	-	-	-	-	-	-	-
SpaceR-7B 2026.05	40.5	-	-	-	-	-	-	-	-	-	-	-	-
SpaceR-SFT-7B 2026.05	40.5	-	-	-	-	-	-	-	-	-	-	-	-
SpatialRGPT 2026.04	39.8	29	37.9	54.3	24.5	46.9	48.5	50.3	48.5	17.5	30.2	44.3	45.2
InternVL3 2026.05	38.8	-	-	-	-	-	-	-	-	-	-	-	-
Spatial-MLLM-4B 2026.05	36.2	-	-	-	-	-	-	-	-	-	-	-	-
VisionSR1 2026.05	35.5	-	-	-	-	-	-	-	-	-	-	-	-
MAmmoTH-VL 2026.05	32.9	-	-	-	-	-	-	-	-	-	-	-	-
InternVL3.5 2026.05	32.8	-	-	-	-	-	-	-	-	-	-	-	-
MAmmoTH-VL 2026.05	32.5	-	-	-	-	-	-	-	-	-	-	-	-
Random Choice 2026.05	20.9	-	-	-	-	-	-	-	-	-	-	-	-
Sherlock 2026.05	11.5	-	-	-	-	-	-	-	-	-	-	-	-
MindCube-3B 2026.05	2.8	-	-	-	-	-	-	-	-	-	-	-	-