Share your thoughts, 1 month free Claude Pro on usSee more

Multi-view spatial reasoning on MINDCUBE Tiny

94.1Overall Accuracy

GAMSI_S1+S2

Updated 23d ago

Evaluation Results

Method
GAMSI_S1+S2 2026.05	94.1	-	-	-
GAMSI_S1 2026.05	75.1	-	-	-
SenseNova-SI-Qwen3-VL-8B 2026.05	73.8	-	-	-
OmniView-Space-R1† 2026.07	71.5	53	79.2	68
Ours 4B (Grounded-CoT) 2026.03	70	71.5	66.33	74.75
SenseNova-SI-InternVL3-8B 2026.05	66.7	-	-	-
DR-MV3D (Qwen2.5-VL-Instruct w/ SFT + GRPO) 2026.06	66.5	43	71.3	73.6
OmniView-Space-R1‡ 2026.07	65.7	48.5	69.2	71.2
DR-MV3D (Qwen2.5-VL-Instruct w/ SFT) 2026.06	62.4	42	66.3	69.2
MINDCUBE-Plain 2026.03	60.76	47.5	62.33	67.6
Ours 2B (Grounded-CoT) 2026.03	59.92	49	56.5	70.5
Gemini-2.5-Pro 2026.06	59.3	85	49.2	58.3
GPT-5.2 2026.07	58.4	95.5	41.5	69.2
DR-MV3D (Qwen2.5-VL-Instruct w/ SFT + GRPO) w/o Anno. 2026.06	57.7	36.5	60.7	67.6
GPT-5 2026.06	56.3	94.5	38.2	68.4
MINDCUBE-Aug 2026.03	55.24	49.5	52.5	66.4
MindCube-CGMap-SFT(Qwen2.5-VL-Instruct) 2026.06	54.4	34.5	54.2	70.8
MindCube-CGMap-FFR-RL(Qwen2.5-VL-Instruct) 2026.06	53.7	33	53.7	70.4
DR-MV3D (Qwen2.5-VL-Instruct w/ SFT) w/o Anno. 2026.06	53.6	36.5	52.2	64
MindCube-RawQA-SFT(Qwen2.5-VL-Instruct) 2026.06	51.7	34	51	67.6
MindCube-3B 2026.07	51.7	34	51	67.6
OmniView-Space-SFT 2026.07	50.9	47	49.8	55.8
SenseNova-SI(Bagel-MoT) 2026.06	50.8	37.5	57.1	46.8
GPT-4.1 2026.07	50.6	49.5	47.2	59.6
MindCube-CGMap-FFR-SFT(Qwen2.5-VL-Instruct) 2026.06	50.1	31.5	49.8	65.6
GPT-4.1 2026.06	49.6	60	46.7	55
OmniView-Space-Zero 2026.07	49.1	32.5	52.8	53.6
Gemini-3-Pro 2026.07	49	54.5	46	51.6
DeepSeek-VL2-Small 2026.03	47.62	37	50.38	26.91
Gemma-3-12B-it 2026.03	46.67	38.39	48.38	34.63
GPT-5-mini 2026.03	46.64	89	44.67	51.75
Claude-4-Sonnet 2026.03	44.75	48.42	44.21	47.62
SpatialLadder-3B 2026.05	43.5	-	-	-
SpatialLadder-3B 2026.07	43.4	35	43.2	50.8
Spatial-MLLM 2026.06	42.8	32.5	47.5	35
Qwen2.5-VL-3B-Instruct 2026.05	42.5	-	-	-
InternVL3-8B 2026.05	41.8	-	-	-
Think3D(Qwen3-VL-RL) 2026.06	41.7	41.7	35	39.2
InternVL3 (8B) 2026.06	41.5	36.5	38.1	53.6
InternVL3-8B 2026.07	41.5	36.5	38.1	53.6
SenseNova-SI(InternVL3) 2026.06	41.2	33.5	44.4	40
Mantis-8B (SigLip) 2026.03	41.05	37.65	40.23	50.99
Openview 2026.03	40.08	24.5	45.5	39.75
Cambrian-S-7B 2026.07	39.7	37	35.9	50.8
VST-7B-SFT 2026.05	39.1	-	-	-
Cambrian-S-3B 2026.05	39	-	-	-
GPT-4o 2026.03	38.81	32.65	40.17	29.16
GPT-5-nano 2026.03	38.58	44	38.67	35.75
Qwen3-VL-8B-Instruct 2026.07	38.4	36	32.8	53.6
Cambrian-S-7B 2026.05	38.1	-	-	-
SpaceR-7B 2026.07	37.9	35	34.2	49.2
Qwen2.5-VL-Instruct (3B) 2026.06	37.8	34	36	45.2
Qwen3-VL-Thinking 2026.06	37.5	55	28.7	44.8
InternVL3 (2B) 2026.06	37.5	28.9	36.9	45.6
Qwen3-VL-8B 2026.03	37.42	46	35.83	35.5
RoBobrain 2026.03	37.38	35.8	38.28	29.53
Molmo2-4B 2026.03	37.33	36	38.83	35.75
InternVL3-2B 2026.05	36.8	-	-	-
Qwen3-VL-4B 2026.03	36.67	41.5	34.67	37.25
VST-3B-SFT 2026.05	36	-	-	-
Qwen3-VL-4B-Instruct 2026.07	35.9	34.1	20	41.6
Idefics2-8B 2026.03	35.86	35.15	35.94	35.49
Qwen3-VL-2B-Instruct 2026.05	35.7	-	-	-
ViLaSR-7B 2026.05	35.2	-	-	-
ViLaSR-7B 2026.07	35	35.5	31	44.4
Random (chance) 2026.06	34.9	38	37	32.8
Bagel-MoT 2026.06	34.7	34.5	31.3	42.8
Molmo2-8B 2026.03	34.33	27.5	36.5	34.5
Bagel-7B-MoT 2026.05	34.2	-	-	-
Qwen2.5-VL-7B-Instruct 2026.05	34.2	-	-	-
Qwen2.5-VL-Instruct (7B) 2026.06	34	37.5	31.2	38
Spatial-MLLM-4B 2026.05	33.5	-	-	-
Spatial-MLLM-4B 2026.07	33.4	39	30.5	36
Random (frequency) 2026.03	33.02	38.3	32.66	35.79
Random (frequency) 2026.06	33	35.7	33.3	31.8
Qwen3-VL-2B 2026.03	32.58	26.5	36.33	30
Random (chance) 2026.03	32.35	36.36	32.29	30.66
SpaceR-7B 2026.05	32.1	-	-	-
Spatial-MLLM 2026.03	32.06	38.39	20.92	32.82
Qwen3-VL-Instruct 2026.06	31.1	26	26.7	46
Qwen3-VL-8B-Instruct 2026.05	29.9	-	-	-
Qwen2.5-VL-7B-Instruct 2026.07	29.3	38.8	29.5	21.4
Qwen2.5-VL-7B 2026.03	29.26	38.76	29.5	21.35
Internvl2.5-8B 2026.03	18.68	36.45	47.11	26.91