Share your thoughts, 1 month free Claude Pro on usSee more

Compositional Reasoning on Lego Puzzles

57.7Accuracy

GPT-4o-0513

Updated 18d ago

Evaluation Results

Method	Links
GPT-4o-0513 2025.11		57.7
Claude-3.5-Sonnet-0620 2025.11		53.6
SpatialThinker-7B (Ours) 2025.11		37.7
Qwen2.5-VL-7B + SFT 2025.11		36.6
Qwen2.5-VL-7B 2025.11		35.8
Qwen2.5-VL-3B + SFT 2025.11		34.7
SpatialThinker-3B (Ours) 2025.11		33.9
VLAA-Thinker-7B 2025.11		33.4
SpaceOm 2025.11		32
SpaceThinker 2025.11		31.5
Qwen2.5-VL-3B 2025.11		29.9
Qwen2.5-VL-7B + Vanilla GRPO 2025.11		29.7
Qwen2.5-VL-3B + Vanilla GRPO 2025.11		27