Our new X account is live! Follow @wizwand_team for updates

Spatial Reasoning on SpatialEval

43.4Spatial Map Score

Magma-8B (Full)

Updated 4d ago

Evaluation Results

Method	Links
Magma-8B (Full) 2025.02		43.4	36.5	64.5	-
Magma-8B (Act) 2025.02		36.9	44.8	37.5	-
Qwen-VL-9.6B 2025.02		28.7	31.8	25.7	-
LLaVA-1.5-7B 2025.02		28.4	28.8	41.6	-
LLaVA-1.6-7B 2025.02		28	34.8	32.2	-
Magma-8B (Full) 2025.02		27.5	33.5	47.3	-
Kimi-VL-A3B-Instruct 2025.10		-	-	-	52.64
Qwen2.5-VL-3B-Instruct 2025.10		-	-	-	55.04
Qwen2.5-VL-32B-Instruct 2025.10		-	-	-	57.99
Qwen2.5-VL-7B-Instruct 2025.10		-	-	-	57.3
Qwen2.5-VL-7B-Instruct + SFT -> RL 2025.10		-	-	-	69.06
REWARDMAP 2025.10		-	-	-	70.81