Share your thoughts, 1 month free Claude Pro on usSee more

Multi-discipline Multimodal Understanding on MMMU Pro

67.3Accuracy

GPT-5-Mini

Updated 5d ago

Evaluation Results

Method
GPT-5-Mini 2025.12	67.3	-
InternVL3.5-38B 2025.12	66	-
Qwen3-VL-32B 2025.12	65.3	-
GLM-4.5V 2025.12	65.2	-
InternVL3-78B 2025.12	62.3	-
Claude-4-Sonnet 2025.12	61.6	-
Qwen3-VL-8B-Masters 2025.12	61.4	-
Masters 2025.12	61.4	-
Qwen2.5-VL-72B 2025.12	61.2	-
Qwen2.5-VL-7B-Masters 2025.12	60.6	-
Masters 2025.12	60.6	-
InternVL3-8B-Masters 2025.12	58.8	-
Masters 2025.12	58.8	-
InternVL3.5-8B-Masters 2025.12	58.1	-
Masters 2025.12	58.1	-
InternVL3.5-8B 2025.12	57.2	-
Qwen3-VL-4B-Masters 2025.12	57	-
Claude-3.7-Sonnet 2025.12	56.5	-
Qwen3-VL-8B 2025.12	55.9	-
Qwen3-VL 2026.03	55.9	-
Active-Zero 2026.02	54.62	-
Gemini-2.0-Flash 2025.12	54.4	-
Qwen3-VL-4B 2025.12	53.2	-
InternVL3.5-4B-Masters 2025.12	52.7	-
Base Model 2026.02	52.61	-
InternVL3.5-2B-Masters 2025.12	52.4	-
VisionZero-RealWorld 2026.02	52.29	-
VisionZero-CLEVR 2026.02	52.17	-
VisPlay 2026.02	51.98	-
GPT-4o 2025.12	51.9	-
VisionZero-Chart 2026.02	51.67	-
EvoLMM 2026.02	51.6	-
Claude-3.5-Sonnet 2025.12	51.5	-
InternVL3.5-4B 2025.12	51.4	-
Qwen2.5-VL-3B-Masters 2025.12	51	-
Gemini-1.5-Pro 2025.12	46.9	-
Active-Zero 2026.02	46.7	-
InternVL3.5-2B 2025.12	46.3	-
MiMo-VL-8B 2025.12	46.2	-
VisPlay 2026.02	42.43	-
Base Model 2026.02	41.99	-
InternVL3-8B 2025.12	41.3	-
Penguin-VL 2026.03	40.2	-
InternVL3-2B-Masters 2025.12	40.1	-
VideoAuto-R1 2026.01	39.8	-
InternVL-3.5 2026.03	39.7	-
Qwen3-VL-2B-Masters 2025.12	39.5	-
Phi-4-Multimodal-5.6B 2025.12	38.5	-
Qwen2.5-VL-7B 2025.12	38.3	-
LLaVA-OneVision-1.5-8B 2025.12	37.4	-
Qwen3-VL-2B 2025.12	36.5	-
OpenAI GPT-5 nano 2026.03	36.5	-
Qwen2.5-VL-7B 2026.01	36.1	-
LLaVA-OneVision-1.5-4B 2025.12	35.3	-
Qwen2.5-VL-3B 2025.12	31.6	-
LLaVA-OneVision-72B 2025.12	31	-
Base 2025.08	29.59	-
Base 2025.08	28.61	-
PSFT 2025.08	27.63	-
MiniCPM-V2.6-8B 2025.12	27.2	-
PSFT 2025.08	26.07	-
InternVL3-2B 2025.12	24.9	-
LLaVA-OneVision-7B 2025.12	24.1	-
SFT 2025.08	23.58	-
Phi-3.5-Vision-4B 2025.12	19.7	-
SFT 2025.08	19.6	-
GPT-4o 2025.12	-	49.7
Gemini-1.5 Pro 2025.12	-	44.4
Claude 3.5 Sonnet 2025.12	-	48
MiMo-VL-RL 2025.12	-	40.3
Cambrian-1 2025.12	-	14.7
Llava-CoT-11B 2025.12	-	18.5
Molmo-8B-D 2025.12	-	18.9
LLaVA-OV 2025.12	-	16.8
LLaVA-OV 2025.12	-	18.7
MAmmoTH-VL 2025.12	-	26
MAmmoTH-VL 2025.12	-	25.3
LLaDA-V 2025.12	-	18.6
Dream-VL 2025.12	-	25.8
Dream-VL 2025.12	-	26
GPT-4o 2026.03	-	54.5
Claude-3.7-Sonnet 2026.03	-	50.1
Qwen2.5-VL-7B 2026.03	-	38.3
InternVL2.5-8B 2026.03	-	38.2
LLaVA-OneVision-7B 2026.03	-	35.5
Llama-3.2-11B-Vision-Instruct 2026.03	-	33
Mulberry-7B 2026.03	-	34.8
R1-OneVision 2026.03	-	32.2
OpenVLThinker 2026.03	-	42.9
ThinkLite-VL 2026.03	-	40
MM-Eureka-7B 2026.03	-	42.4
Vision-R1 2026.03	-	39.6
VLAA-Thinker-7B 2026.03	-	40.9
Vision-SR1 2026.03	-	43.8
AVAR-Thinker 2026.03	-	42.9