Our new X account is live! Follow @wizwand_team for updates

Multimodal Reasoning on MathVision

73.3Pass@1

Gemini 1.5 Pro

Updated 3d ago

Evaluation Results

Method	Links
Gemini 1.5 Pro 2025.05		73.3	-
Seed 1.5-VL 2025.05		68.7	-
Seed 1.5-VL 2025.05		65.5	-
OpenAI o1 2025.05		63.2	-
Claude 3.7 Sonnet 2025.05		58.6	-
Qwen 2.5-VL 72B 2025.05		38.1	-
GPT-4o 2025.05		31.2	-
SaEI 2025.12		28.17	-
KL-Cov 2025.12		27.92	-
NoisyRollout 2025.12		27.7	-
Vanilla GRPO 2025.12		27.61	-
Socratic-Solver-Geo (Stage3) 2026.02		26.19	-
Qwen2.5-VL-7B-Instruct 2025.12		25.95	-
Geo170k (G-LLaVA) 2026.02		24.34	-
GeoReasoning 2026.02		24.34	-
Socratic-Solver-Geo (Stage2) 2026.02		23.54	-
KD (Our Synthesis) 2026.02		23.01	-
TrustGeoGen 2026.02		22.89	-
PGPS9K 2026.02		22.74	-
R-CoT 2026.02		22.72	-
Qwen2.5-VL-7B-Instruct 2026.02		22.7	-
KD (Geo3K) 2026.02		22.68	-
Socratic-Solver-Geo (Stage1) 2026.02		22.45	-
Qwen2.5-VL-7B-Instruct (w/o RLVR) 2026.02		-	26.2
GRPO 2026.02		-	28.7
GSPO 2026.02		-	27.7
LUSPO 2026.02		-	28
GPT-4V 2026.01		-	22.76
InternVL2.5 8B 2026.01		-	22
Qwen2.5VL 7B 2026.01		-	19.5
R1-Onevision 7B 2026.01		-	29.9
VLAA-Thinker 7B 2026.01		-	26.4
VisonR1 7B 2026.01		-	29.9
MixedR1 7B 2026.01		-	30.3
Ours 2026.01		-	26.7
Ours [with DPS] 2026.01		-	26.1
Ours [with DPS and annealing] 2026.01		-	26.1
Qwen2.5-VL-7B 2026.02		-	25.6
DeepEyes 2026.02		-	26.6
Thyme 2026.02		-	27.6
CodeDance 2026.02		-	29.6
DeepEyes-v2 2026.02		-	28.9
PyVision-Image 2026.02		-	28.7