Share your thoughts, 1 month free Claude Pro on usSee more

Spatial Relationship Reasoning on SPAR-Bench

61.9Accuracy (Avg)

Ours-DTR

Updated 24d ago

Evaluation Results

Method
Ours-DTR 2026.06	61.9	61.1	46.9	68.3
Ours-LOR 2026.06	60.5	58.5	47.7	67.3
GAMSI_S1+S2 2026.05	59.9	-	-	-
GPT-5.2 2026.07	52.6	43.7	41.5	66.4
GAMSI_S1 2026.05	49.6	-	-	-
SenseNova-SI-InternVL3-8B 2026.05	48.9	-	-	-
VST 2026.06	48.9	53.3	25.4	53.7
VST-7B-SFT 2026.05	47.2	-	-	-
OmniView-Space-R1† 2026.07	44.8	44.1	38.1	47.8
Gemini-3-Pro 2026.07	43.1	40.6	21.7	58
OmniView-Space-R1‡ 2026.07	42.3	43.2	34.3	44.2
SenseNova-SI-Qwen3-VL-8B 2026.05	41.1	-	-	-
Qwen3-VL-8B-Instruct 2026.05	39.9	-	-	-
GPT-4.1 2026.07	39.9	38.2	37	43.1
Qwen3-VL-8B 2026.06	39.6	35.7	30	46.7
OmniView-Space-Zero 2026.07	39.6	33.5	35.8	46.3
SpaceR 2026.06	39.2	32.3	33	47.6
Bagel-7B-MoT 2026.05	39.1	-	-	-
VST-3B-SFT 2026.05	38.1	-	-	-
Cambrian-S-7B 2026.05	38	-	-	-
Cambrian-S-7B 2026.07	37.9	29.7	31.3	49.6
ViLaSR-7B 2026.07	37.4	35.3	29	42.5
SpaceR-7B 2026.05	37.3	-	-	-
ViLaSR-7B 2026.05	37.3	-	-	-
InternVL3-8B 2026.07	37.3	28.1	39.3	45
Qwen3-VL-8B-Instruct 2026.07	36.5	35.6	32.9	39.6
GPT-4o 2026.05	36.4	29.3	24.9	45.1
InternVL3-8B 2026.05	35.8	-	-	-
Qwen3-VL-4B-Instruct 2026.07	35.6	30.8	33.1	40.5
LLaVA-OneVision-1.5-8B 2026.06	35.5	31.9	26	42.4
Spatial-MLLM-4B 2026.05	35.3	-	-	-
SpatialLadder 2026.06	34.4	25.8	33.2	42.6
SpaceR-7B 2026.07	34.2	27	23.9	44.6
Qwen2.5-VL-7B-Instruct 2026.05	33.8	-	-	-
Qwen2.5-VL-7B-Instruct 2026.07	33.8	27.6	27.6	41.8
SR-3D (Base) 2026.06	33.4	24.1	37.6	40.1
Qwen3-VL-2B-Instruct 2026.05	33.3	-	-	-
OmniView-Space-SFT 2026.07	33.1	26.6	32.5	38.9
SpatialLadder-3B 2026.05	32.9	-	-	-
Cambrian-S-3B 2026.05	32.9	-	-	-
SpatialLadder-3B 2026.07	32.9	24.9	29.4	42.4
NVILA-8B-Lite (Base) 2026.06	32.3	24.9	28.6	40.3
LLaVA-OneVision-7B 2026.05	31.2	21.8	26.1	40.1
InternVL-2.5-4B 2026.05	30.6	25.7	29.8	35.2
Spatial-MLLM-4B 2026.07	30.4	22.3	32.4	35.2
Qwen2.5-VL-7B 2026.05	30.2	17.5	29.5	41.8
Qwen2.5-VL-7B 2026.06	30.2	17.5	29.5	41.8
Qwen2.5-VL-3B-Instruct 2026.05	30	-	-	-
InternVL2.5-8B 2026.06	29.7	21.7	31.1	36.3
Kimi-VL-A3B 2026.05	29.4	26.4	18.8	36.2
SpatialRGPT 2026.06	28	26	22	32.1
CaMo-3B 2026.05	27.6	13	31.3	42.6
InternVL3-2B 2026.05	27.2	-	-	-
Qwen2.5-VL-3B 2026.05	24.6	15.3	26.4	32.2
Cosmos-Reason1-7B 2026.06	22.8	23.4	19.4	24.2
ViGoRL 2026.06	21.1	25	18.1	18.6
MindCube-3B 2026.07	20.8	16.8	22.6	23.9