SOTA Multimodal Reasoning on MMMU (val) and PapersWithCode

78.2Accuracy

OpenAI-o1

Updated 1mo ago

Evaluation Results

Method	Links
OpenAI-o1 2025.06		78.2
Claude-Sonnet-3.7 2025.12		75
Qwen3-VL-8B-Thinking 2025.12		74.1
GPT-5-Nano 2025.12		72.6
Keye-VL-1.5-8B 2025.12		71.4
InternVL3.5-8B-MPO 2025.12		71.2
Qwen3-VL-8B-Instruct + CARE 2025.12		71
Claude-3.7-Sonnet 2025.06		71
Qwen3-VL-4B-Thinking 2025.12		70.8
Qwen2.5-VL-72B 2025.12		70.2
Qwen2.5-VL-72B-IT 2025.06		70.2
InternVL2.5-78B 2024.12		70.1
Gemini-2.0-Pro 2025.12		69.9
Qwen3-VL-8B-Instruct 2025.12		69.6
GPT-4o 2024.07		69.1
GPT-4o-20240513 2024.12		69.1
GPT-4o 2025.06		69.1
Claude 3.5 2024.07		68.3
Claude-3.5-Sonnet 2024.12		68.3
InternVL3.5-8B-Instruct 2025.12		68.1
Qwen3-VL-4B-Instruct 2025.12		67.4
MiMo-VL-7B-RL 2025.12		66.7
MiMo-VL-7B-SFT 2025.12		64.6
Llama 3-V 405B 2024.07		64.5
Qwen2-VL-72B 2024.12		64.5
InternVL2.5-38B 2024.12		63.9
GPT-4V 2024.12		63.1
InternVL2-Llama3-76B 2024.12		62.7
Qwen2.5-VL-7B + CARE 2025.12		62.5
Gemini 1.5 Pro 2024.07		62.2
Qwen2.5-VL-7B + GSPO 2025.12		62.2
Gemini-1.5-Pro 2024.12		62.2
Qwen2.5-VL-7B + DAPO 2025.12		61.6
Qwen2.5-VL-7B 2025.12		61.3
Qwen2.5-VL-7B + GRPO 2025.12		61.1
Perception-R1-7B 2025.06		60.8
Llama 3-V 70B 2024.07		60.6
InternVL2.5-26B 2024.12		60
NVLM-D-72B 2024.12		59.7
OpenVLThinker-7B 2025.06		58.4
MM-Eureka-7B 2025.06		58
ReLaX-VL-7B 2025.12		57.4
SRPO-7B 2025.12		57.1
Intern-S1 2026.01		57
InternVL3.5 2026.01		56.89
LLaVA-OneVision-72B 2024.12		56.8
VL-Rethinker-7B 2025.12		56.7
SophiaVL-R1-7B 2025.06		56.7
GPT-4V 2024.07		56.4
Intern2.5-VL-8B 2025.12		56
InternVL2.5-8B 2024.12		56
InternVL2.5-8B 2025.06		56
Kimi-VL-16B 2025.12		55.7
LLaVA-OV 2026.01		55.44
LLaVA-OneVision-1.5 8B 2025.12		55.4
Innovator-VL 2026.01		55.22
MM-Eureka-7B 2025.12		55.2
InternVL2-40B 2024.12		55.2
Qwen2.5-VL-7B-IT 2025.06		55.2
Vision-R1-7B 2025.06		55.2
VILA-1.5-40B 2024.12		55.1
Ovis1.6-Gemma2-9B 2024.12		55
Vision-R1-7B 2025.12		54.7
VLAA-Thinker-7B 2025.06		54.7
Qwen2.5-VL-7B 2025.12		54.3
Qwen2-VL-7B 2025.12		54.1
Qwen2-VL-7B 2024.12		54.1
Molmo-72B 2024.12		54.1
R1-OneVision-7B 2025.06		52.9
Qwen2.5-VL-3B-Instruct 2025.05		52.78
InternVL2-8B 2024.12		52.6
SFT-M 2026.02		52.56
OpenVLThinker-7B 2025.12		52.5
InternVL2.5-4B 2025.12		52.3
InternVL2.5-4B 2024.12		52.3
R1-VL-7B 2025.06		52.3
Innovator-VL 2026.01		52.22
ReLaX-VL-3B 2025.12		52.2
GRPO 2026.02		51.89
SFT 2026.02		51.67
Qwen3-VL 2026.01		51.44
Intern2-VL-8B 2025.12		51.2
InternVL2-26B 2024.12		51.2
SFT-RS 2026.02		50.33
SFT-M 2026.02		50.11
MiniCPM-V2.6 2024.12		49.8
Cambrian-34B 2024.12		49.7
Llama 3-V 8B 2024.07		49.6
Qwen2.5VL-3B 2025.12		49.6
MiMo-VL 2026.01		49.44
Intern3.5-VL 2026.03		49.33
MM-Eureka-8B 2025.12		49.2
Llava-OV-7B 2025.12		48.8
Uni-MuMER-LLAVA 2025.05		48.67
GRPO 2026.02		48.56
MiniCPM-V 2026.01		48.44
MiMo-VL 2026.01		48.11
InternVL2-4B 2024.12		47.9
Uni-MuMER 2025.05		47.89
SFT 2026.02		47.45

Showing 100 of 144 rows