Share your thoughts, 1 month free Claude Pro on usSee more

Mathematical Reasoning on MathVision

75.95Accuracy

STEP3-VL-10B (PaCoRe)

Updated 4d ago

Evaluation Results

Method
STEP3-VL-10B (PaCoRe) 2026.01	75.95	-	-	-	-	-
Gemini-2.5 (Pro) 2026.01	73.3	-	-	-	-	-
Qwen3-VL (Thinking) 2026.01	72.1	-	-	-	-	-
GPT-5-Thinking* 2025.09	72	-	-	-	-	-
STEP3-VL-10B (SeRe) 2026.01	70.81	-	-	-	-	-
Gemini-2.5-Pro* 2025.09	69.1	-	-	-	-	-
Human 2025.02	68.8	-	-	-	61.3	-
ERNIE 5.0-Base 2026.02	68.75	-	-	-	-	-
Seed-1.5-VL (Thinking) 2026.01	68.7	-	-	-	-	-
GLM-4.6V 2026.01	63.5	-	-	-	-	-
Claude-3.7-Sonnet 2026.03	58.6	-	-	-	-	-
InternVL3.5 2025.10	56.8	-	-	-	-	-
Bee-8B 2025.10	50	-	-	-	-	-
Bee-8B 2025.10	46.8	-	-	-	-	-
Claude-3.5-Sonnet 2026.02	46.48	-	-	-	-	-
Keye-VL 2025.10	46	-	-	-	-	-
InternVL3.5-2B 2025.12	42.8	-	-	-	-	-
Claude 3.7 2026.03	41.3	-	-	-	-	-
Qwen2.5-VL-32B 2026.02	38.4	-	-	-	-	-
AVAR-Thinker 2026.03	37.4	-	-	-	-	-
V-STAR 2026.04	33.7	-	-	-	-	-
VL-Rethinker-7B + LEAD 2026.03	33.1	-	-	-	-	-
ThinkLite-VL 2026.03	32.9	-	-	-	-	-
ThinkLite-VL 2026.04	32.9	-	-	-	-	-
AStar 2025.02	32.7	-	-	-	39.4	-
R1-Onevision-7B + LEAD 2026.03	32.4	-	-	-	-	-
VL-Cogito-7B + LEAD 2026.03	32.4	-	-	-	-	-
VL-Rethinker-7B 2026.03	32.3	-	-	-	-	-
VL-Rethinker 2026.04	32.3	-	-	-	-	-
InternVL2.5-38B 2026.02	32.2	-	-	-	-	-
VAPO-Thinker-7B 2025.09	31.9	-	-	-	-	-
SketchThinker-R1-7B 2026.01	31.7	65.5	0.484	-	-	-
Qwen3-VL-2B 2025.12	31.6	-	-	-	-	-
GPT-4o 2026.03	31.2	-	-	-	-	-
Vanilla-R1 2026.01	31	221.1	0.14	-	-	-
VL-Cogito-7B 2026.03	30.7	-	-	-	-	-
VL-Cogito 2026.04	30.7	-	-	-	-	-
GPT-4o 2025.02	30.4	-	-	-	29.4	-
GPT-4o 2026.03	30.4	-	-	-	-	-
GPT-4o 2026.04	30.39	-	-	-	-	-
GPT-4o 2026.02	30.3	-	-	-	-	-
R1-OneVision 2026.03	29.9	-	-	-	-	-
R1-Onevision-7B 2026.03	29.9	-	-	-	-	-
R1-OneVision-7B 2025.09	29.9	-	-	-	-	-
R1-Onevision 2026.04	29.9	-	-	-	-	-
Vision-R1-7B + LEAD 2026.03	29.7	-	-	-	-	-
ThinkPrune 2026.01	29.6	136.3	0.217	-	-	-
VL-Rethinker-7B 2026.02	29.57	-	-	-	-	-
L1 2026.01	29.5	146.7	0.201	-	-	-
InternVL3 2026.03	29.3	-	-	-	-	-
VL-Rethinker 2026.04	29.3	-	-	-	-	-
VeriThinker 2026.01	29.1	152.5	0.191	-	-	-
DeepEyesV2 2026.03	28.9	-	-	-	-	-
RuCL 2026.02	28.88	-	-	-	-	-
C3oT 2026.01	28.8	125.5	0.229	-	-	-
InternVL3.5-8B 2026.04	28.3	-	-	-	-	-
MIRROR(ours) 2026.02	28.29	-	-	-	-	-
Vision-R1-7B 2025.09	28.2	-	-	-	-	-
Auxiliary Reward 2026.03	28.06	-	-	-	-	-
Perception-R1-7B 2026.02	28.06	-	-	-	-	-
GeoFocus 2026.02	28	-	-	-	-	-
AStar 2025.02	27.9	-	-	-	29.4	-
GRPO 2026.02	27.7	-	-	-	-	-
MM-Eureka-7B 2026.02	27.7	-	-	-	-	-
Semantic-back 2026.03	27.7	-	-	-	-	-
Thyme 2026.03	27.6	-	-	-	-	-
Trajectory-Hint 2026.03	27.43	-	-	-	-	-
Chain-of-Draft 2026.01	27.4	85.4	0.321	-	-	-
MIRROR(w/o tool) 2026.02	27.3	-	-	-	-	-
Vision-R1-7B 2026.02	27.24	-	-	-	-	-
ThinkLite-VL-7B 2026.02	27.24	-	-	-	-	-
Vision-R1-7B 2026.03	27.2	-	-	-	-	-
Vision-R1 2026.04	27.2	-	-	-	-	-
Ctrl-R 2026.03	27.14	-	-	-	-	-
R1-VL-7B 2025.02	27.1	-	-	-	23.6	-
MM-Eureka-7B 2026.03	26.9	-	-	-	-	-
Vision-SR1 2026.03	26.7	-	-	-	-	-
DeepEyes 2025.05	26.6	-	-	-	-	-
DeepEyes 2026.04	26.6	-	-	-	-	-
InternVL3.5-2B 2025.12	26.5	-	-	-	-	-
VRE 2026.03	26.5	-	-	-	-	-
VLAA-Thinker-7B 2026.03	26.4	-	-	-	-	-
VLAA-Thinker-7B 2025.09	26.4	-	-	-	-	-
Constrained CoT 2026.01	26.2	79.2	0.331	-	-	-
URSA-8B 2025.02	26.2	-	-	-	24.8	-
OpenVLThinker-7B 2026.02	25.9	-	-	-	-	-
OpenVLThinker 2026.03	25.9	-	-	-	-	-
OpenVLThinker 2026.04	25.9	-	-	-	-	-
SCF-VR 2026.04	25.89	-	-	-	-	-
OpenVLThinker 2026.03	25.79	-	-	-	-	-
Qwen2.5-VL-3B 2026.02	25.66	-	-	-	-	-
Qwen2.5-VL* 2025.05	25.6	-	-	-	-	-
InternVL2.5-8B* 2025.09	25.6	-	-	-	-	-
Qwen2.5-VL-7B 2026.04	25.6	-	-	-	-	-
Qwen2.5-VL 2025.10	25.4	-	-	-	-	-
GRPO 2026.03	25.39	-	-	-	-	-
Baseline 2026.02	25.3	-	-	-	-	-
Qwen2.5-VL-7B 2026.03	25.2	-	-	-	-	-
Qwen2.5-VL 2025.05	25.1	-	-	-	-	-
MM-Eureka 2026.03	24.7	-	-	-	-	-

Showing 100 of 160 rows