Share your thoughts, 1 month free Claude Pro on usSee more

Multimodal Reasoning on MMMU

83.89Accuracy

Gemini-2.5 (Pro)

Updated 7d ago

Evaluation Results

Method	Links
Gemini-2.5 (Pro) 2026.01		83.89
S1-VL-32B-RL 2026.04		83.4
S1-VL-32B-SFT 2026.04		82.5
Claude Sonnet 4.5 2025.11		82
Gemini 2.5 Pro 2026.04		82
Qwen3.5 2026.05		81.4
GPT-5 2026.04		81.22
SenseNova-U1 2026.05		80.55
STEP3-VL-10B (PaCoRe) 2026.01		80.11
Seed-1.5-VL (Thinking) 2026.01		79.11
Gemini 2.5 Pro 2025.11		79
Qwen3-VL (Thinking) 2026.01		78.7
Qwen3.5 2026.05		78.4
STEP3-VL-10B 2026.01		78.11
STEP3-VL-10B (SeRe) 2026.01		78.11
Qwen3-VL-235B-A22B-Thinking 2026.04		77.89
GPT-5 high 2025.11		77
Gemma4 2026.05		76.56
Qwen3-VL-32B-Thinking 2026.04		76
Qwen3VL 2026.05		76
Athena-PRM 2025.06		75.8
Intern-S1 2026.04		75.56
GLM-4.6V 2026.01		75.2
Claude-3.7-Sonnet 2025.06		75
SenseNova-U1 2026.05		74.78
Qwen3VL 2026.05		74.1
Qwen3-VL Thinking 2026.01		73.53
Gemini 2.5 Flash 2026.04		72.7
Gemini-2.0-Flash 2025.06		72.6
Qwen2.5-VL-72B w/ RAPID 2025.06		72.4
Athena-ORM 2025.06		72.3
InternVL3-78B 2025.06		72.2
InternVL 3.5 2026.01		71.69
GLM-4.6V Flash 2026.01		71.17
MiMo-VL RL-2508 2026.01		71.14
Self-consistency 2025.06		71.1
GPT-4o-20241120 2025.06		70.7
Gemini-2.0-Flash 2025.11		70.7
LongCat-Next 2026.05		70.6
QVQ-72B-Preview 2025.06		70.3
QvQ-72B-Preview 2025.11		70.3
Qwen2.5-VL-72B 2025.06		70.2
InternVL3-38B 2025.06		70.1
Intern-S1-mini 2026.04		70
Qwen2.5-VL-32B w/ RAPID 2025.06		69.8
ICLA 2026.02		69.2
Sora-2 Audio 2025.11		69.2
Qwen2.5-VL-32B 2025.06		69
VCD 2026.02		68.3
Qwen2.5-VL-72B 2025.06		68.2
Qwen2.5-VL-72B 2025.06		68.2
Qwen2.5-VL-32B w/ RAPID 2025.06		67.8
Vanilla 2026.02		67.5
RLSD 2026.04		67.22
VL-Rethinker-72B 2025.06		67.2
InternVL3-14B 2025.06		67.1
Ovis2-34B 2025.06		66.7
VDD 2026.02		65.8
DAMO 2026.02		65.8
GRPO 2026.04		65.11
SDPO 2026.04		65.11
Gemma-3-27B 2025.12		64.9
Gemma-3-27B 2025.06		64.9
Qwen2.5-VL-7B w/ RAPID 2025.06		64.7
MiMo-VL-7B 2026.03		64.6
OPSD 2026.04		63.82
Athena-PRM 2025.06		63.8
GRPO + OPSD 2026.04		63.22
MM-Eureka-Qwen-32B 2025.11		63.2
InternVL3-8B 2025.12		62.7
InternVL3-8B 2025.06		62.7
InternVL3-8B 2025.11		62.7
Athena-ORM 2025.06		62.7
MiMo-VL-7B +PC 2026.03		62.6
DeCo 2026.02		62.5
Base LLM 2026.04		62.44
OmniCaptioner 2025.06		62.2
MM-Eureka-32B 2025.06		62
MM-Eureka-Qwen-7B 2025.11		62
ECSO 2025.06		61.4
Qwen2.5-VL-3B w/ RAPID 2025.06		60.9
DoLA 2026.02		60.8
Ovis2-16B 2025.06		60.7
Athena-PRM 2025.06		60.3
VisualPRM-8B 2025.06		60.2
Self-consistency 2025.06		60.1
VL-Rethinker-7B 2025.11		60
Gemini Ultra 2023.02		59.4
MM-Eureka-Qwen-32B 2025.11		59.3
Athena-ORM 2025.06		59.1
InternVL3.5-2B 2025.12		59
InternVL3.5 2025.12		59
InternVL3.5 2026.03		59
MMR1-Math-v0-7B 2025.11		58.7
MM-Eureka-Qwen-7B 2025.11		58.7
VL-Rethinker-7B 2025.11		58.7
SPARK-VL-7B 2026.05		58.7
Qwen2.5-VL-7B 2025.11		58.6
Qwen2.5 2026.05		58.6
Qwen2.5-VL-7B-Instruct 2026.05		58.6

Showing 100 of 208 rows