Share your thoughts, 1 month free Claude Pro on usSee more

Multimodal Reasoning on MMMU Pro (Accuracy)

85.6Accuracy

CoT2-Meta

Updated 8d ago

Evaluation Results

Method	Links
CoT2-Meta 2026.03		85.6
ReST-MCTS* 2026.03		81.3
Vanilla ToT 2026.03		77.8
Gemini-2.5 (Pro) 2026.01		76.96
Best-of-16 2026.03		73.1
Qwen3-VL (Thinking) 2026.01		72.37
Seed-1.5-VL (Thinking) 2026.01		70.6
Greedy CoT 2026.03		68.4
STEP3-VL-10B (PaCoRe) 2026.01		67.18
GLM-4.6V 2026.01		65.84
STEP3-VL-10B (SeRe) 2026.01		64.08
OpenAI-o1 2025.06		62.4
GPT-4o 2026.01		56.13
DLR 2026.04		56.1
LVR 2026.04		55.3
PixelReasoner 2026.04		53.1
GPT-4o 2026.01		51.9
GPT-4o 2025.06		51.9
GPT-4o 2026.04		51.9
Claude-3.7-Sonnet 2025.06		51.5
Gemini-1.5-Pro 2026.01		51.47
Qwen3-VL-8B-Thinking 2026.04		50.2
ICoT 2026.04		49.6
Qwen2.5-VL-72B-IT 2025.06		49.5
Qwen3-VL-8B-Instruct + CARE 2025.12		46.7
MiMo-VL-7B-RL 2025.12		46.2
MiMo-VL-7B-SFT 2025.12		45.2
Perception-R1-7B 2025.06		42.4
PRCO-7B 2026.03		42.08
Qwen3-VL-8B-Instruct + CARE 2025.12		41.7
PAPO-D-7B 2026.03		41.5
DAPO 2026.03		41.38
Vision-SR1-7B 2026.03		41.38
Ours [with DPS and annealing] 2026.01		41
Ours [with DPS] 2026.01		40.7
Ours 2026.01		40.6
MiMo-VL-7B-RL 2025.12		40.3
PAPO-G-7B 2026.03		40.11
Qwen2.5-VL-7B + CARE 2025.12		39.7
VPPO-7B 2026.03		39.65
VLAA-Thinker 7B 2026.01		39.5
MiMo-VL-7B-SFT 2025.12		39.4
GRPO 2026.03		39.01
Qwen2.5-VL-7B + GSPO 2025.12		38.9
SophiaVL-R1-7B 2025.06		38.8
R1-ShareVL-7B 2026.03		38.32
MM-Eureka-7B 2025.06		38.3
Perception-R1-7B 2026.03		38.2
Qwen2.5VL 7B 2026.01		38
MixedR1 7B 2026.01		38
OpenVLThinker-7B 2025.06		37.8
Vision-R1-7B 2025.06		37.6
LLaVA-OneVision-1.5 8B 2025.12		37.4
Qwen2.5-VL-7B + DAPO 2025.12		37.3
VLAA-Thinker-7B 2025.06		37.2
Qwen2.5-VL-7B + CARE 2025.12		37.1
Vision-Matters-7B 2026.03		37.1
Qwen2.5-VL-7B-IT 2025.06		37
Qwen3-VL 2026.03		36.5
Qwen2.5-VL-7B + GRPO 2025.12		36.4
Qwen2.5-VL-7B + GSPO 2025.12		36.4
Qwen2.5-VL-7B 2025.12		36.3
NoisyRollout-7B 2026.03		36.3
Base Model 2026.03		35.49
MMR1-7B-RL 2026.03		35.08
Qwen2.5-VL-7B + DAPO 2025.12		34.7
InternVL2.5 8B 2026.01		34.3
InternVL2.5-8B 2025.06		34.3
R1-Onevision 7B 2026.01		33.9
R1-OneVision-7B 2025.06		33.8
Vision-SR1-3B 2026.03		33.12
Qwen2.5-VL-3B + CARE 2025.12		33.1
Qwen2.5-VL-7B 2025.12		32.8
Qwen2.5-VL-7B + GRPO 2025.12		32.8
PRCO-3B 2026.03		31.85
DAPO 2026.03		31.73
InternVL3.5 2026.03		31.6
Penguin-VL 2026.03		31.4
PAPO-D-3B 2026.03		31.27
Qwen2.5-VL-3B 2025.12		31.1
Qwen2-VL 2026.01		30.5
MMR1-3B-RL 2026.03		30.34
VisonR1 7B 2026.01		30.3
GRPO 2026.03		29.88
Qwen2-VL-7B-IT 2025.06		29.6
R1-VL-7B 2025.06		29.4
PAPO-G-3B 2026.03		29.01
InternVL2 2026.01		29
Qwen3-VL 2025.12		28.1
Gemma3n E2B-it 2026.03		28
NVILA 2026.01		27.8
LinMU-NV 2026.01		27.3
Base Model 2026.03		26.76
LLaVA-OneVision-1.5 8B 2025.12		25.2
LLaVA-OV 2026.01		24.1
Qwen2.5-VL-3B + CARE 2025.12		24
HyperVL 2025.12		23.9
HyperVL ViTL 2025.12		23.8
InternVL3.5 2025.12		23.6
SAIL-VL2 2025.12		22.2

Showing 100 of 107 rows