Share your thoughts, 1 month free Claude Pro on usSee more

Spatial Reasoning on MMSI-Bench

97.2Accuracy

Human

Updated 5d ago

Evaluation Results

Method	Links
Human 2026.02		97.2
GEMINI-3-PRO-PREVIEW 2026.02		45.2
GPT-5 2026.02		41.8
GPT-5 2026.04		41.8
SEED-1.6 2026.02		38.3
Seed-1.6 2026.04		38.3
GEMINI-2.5-PRO 2026.02		38
Gemini-2.5-Pro 2026.04		38
Qwen3-VL + Ours 2026.03		32.6
VST-7B-SFT 2026.02		32
VST-SFT 2026.03		32
GeoThinker QWEN2.5VL-7B 2026.02		31.7
Qwen3-VL 2026.03		31.1
Qwen3-VL-8B 2026.05		31.1
BAGEL-7B-MOT 2026.02		31
Bagel-7B-MOT 2026.04		31
GeoThinker QWEN3VL-8B 2026.02		30.9
GPT-4o 2026.05		30.3
VST-3B-SFT 2026.02		30.2
VST-SFT 2026.03		30.2
GUIDE-5B 2026.04		30.2
VG-LLM-8B* 2026.02		30
VG-LLM-8B* 2026.04		30
GUIDE-9B 2026.04		29.6
GR3D-8B 2026.05		29.2
QWEN3-VL-8B-INSTRUCT 2026.02		28.8
Qwen3-VL-8B-Instruct 2026.04		28.8
InternVL2.5-8B 2026.05		28.7
QWEN2.5-VL-3B-INSTRUCT 2026.02		28.6
VG-LLM-8B 2026.02		28.4
VG-LLM-8B 2026.04		28.4
before RL 2025.08		28.2
NVILA-8B 2026.05		28.1
INTERNVL3-8B 2026.02		28
VG-LLM-4B 2026.02		28
Intern3-VL-8B 2026.03		28
InternVL3-8B 2026.04		28
VG-LLM-4B 2026.04		28
Vision-SR1 2025.08		28
VLM-3R-7B 2026.02		27.9
VLM-3R-7B 2026.04		27.9
Vision-R1 2025.08		27.7
Vision-SR1 2025.08		27.7
Qwen3-VL + Ours 2026.03		27.6
SPATIALLADDER-3B 2026.02		27.4
SpaceR-SFT-7B 2026.03		27.4
SpatialLadder-3B 2026.04		27.4
Spatial-MLLM 2026.03		27
QWEN2.5-VL-7B-INSTRUCT 2026.02		26.8
INTERNVL3-2B 2026.02		26.5
InternVL3-2B 2026.04		26.5
Qwen3-VL 2026.03		26.1
Spatial-MLLM-4B 2026.04		26.1
Qwen2.5-VL-7B 2026.05		25.9
CAMBRIAN-S-7B 2026.02		25.8
Cambrian-S 2026.03		25.8
SR-3D-8B 2026.05		25.8
CAMBRIAN-S-3B 2026.02		25.2
Cambrian-S 2026.03		25.2
Cambrian-S-3B 2026.04		25.2
Random Choice 2026.02		25
Random Choice 2026.04		25
before RL 2025.08		24
Vision-R1 2025.08		21.9
QWEN3-VL-2B-INSTRUCT 2026.02		11.9