Share your thoughts, 1 month free Claude Pro on usSee more

Multimodal Reasoning on MMMU

83.89Accuracy

Gemini-2.5 (Pro)

Updated 10d ago

Evaluation Results

Method	Links
Gemini-2.5 (Pro) 2026.01		83.89
Claude Sonnet 4.5 2025.11		82
STEP3-VL-10B (PaCoRe) 2026.01		80.11
Seed-1.5-VL (Thinking) 2026.01		79.11
Gemini 2.5 Pro 2025.11		79
Qwen3-VL (Thinking) 2026.01		78.7
STEP3-VL-10B 2026.01		78.11
STEP3-VL-10B (SeRe) 2026.01		78.11
GPT-5 high 2025.11		77
GLM-4.6V 2026.01		75.2
Claude-3.7-Sonnet 2025.06		75
Qwen3-VL Thinking 2026.01		73.53
Gemini-2.0-Flash 2025.06		72.6
Qwen2.5-VL-72B w/ RAPID 2025.06		72.4
InternVL3-78B 2025.06		72.2
InternVL 3.5 2026.01		71.69
GLM-4.6V Flash 2026.01		71.17
MiMo-VL RL-2508 2026.01		71.14
GPT-4o-20241120 2025.06		70.7
QVQ-72B-Preview 2025.06		70.3
InternVL3-38B 2025.06		70.1
Qwen2.5-VL-32B w/ RAPID 2025.06		69.8
ICLA 2026.02		69.2
Sora-2 Audio 2025.11		69.2
Qwen2.5-VL-32B 2025.06		69
VCD 2026.02		68.3
Qwen2.5-VL-72B 2025.06		68.2
Qwen2.5-VL-72B 2025.06		68.2
Qwen2.5-VL-32B w/ RAPID 2025.06		67.8
Vanilla 2026.02		67.5
RLSD 2026.04		67.22
VL-Rethinker-72B 2025.06		67.2
InternVL3-14B 2025.06		67.1
Ovis2-34B 2025.06		66.7
VDD 2026.02		65.8
DAMO 2026.02		65.8
GRPO 2026.04		65.11
SDPO 2026.04		65.11
Gemma-3-27B 2025.12		64.9
Gemma-3-27B 2025.06		64.9
Qwen2.5-VL-7B w/ RAPID 2025.06		64.7
MiMo-VL-7B 2026.03		64.6
OPSD 2026.04		63.82
GRPO + OPSD 2026.04		63.22
InternVL3-8B 2025.12		62.7
InternVL3-8B 2025.06		62.7
MiMo-VL-7B +PC 2026.03		62.6
DeCo 2026.02		62.5
Base LLM 2026.04		62.44
OmniCaptioner 2025.06		62.2
MM-Eureka-32B 2025.06		62
ECSO 2025.06		61.4
Qwen2.5-VL-3B w/ RAPID 2025.06		60.9
DoLA 2026.02		60.8
Ovis2-16B 2025.06		60.7
Gemini Ultra 2023.02		59.4
InternVL3.5-2B 2025.12		59
InternVL3.5 2025.12		59
InternVL3.5 2026.03		59
Qwen2.5-VL-7B (Bo8) 2025.06		58.1
Ovis2-8B 2025.06		57.4
Qwen2.5-VL-7B 2025.06		57.3
ARM-Thinker-7B 2025.12		57.2
SRPO-7B 2025.06		57.1
VL-Rethinker-7B 2025.06		56.9
GPT-4V(ision) 2023.02		56.8
Qwen2.5-VL-7B +PC 2026.03		55.8
ReVisual-R1-7B 2025.06		55.7
BAGEL 2026.03		55.3
Gemma-3-12B 2025.06		55.2
Qwen2.5-VL-7B 2025.12		55
MM-Eureka-7B 2025.06		54.9
InternVL-U 2026.03		54.7
Qwen2.5-VL-3B +PC 2026.03		54
Qwen3-VL-2B 2025.12		53.4
Qwen3-VL 2025.12		53.4
Qwen2.5-VL-3B 2026.03		53.1
Qwen2.5-VL 2026.03		53.1
MetaQuery-L 2026.03		53.1
Qwen-VL 2.5 2026.03		52.89
Qwen2.5-VL-7B 2026.03		52.8
InternVL3.5-2B 2025.11		51.78
Qwen2.5-VL-3B 2025.11		51.67
Ovis-U1 2026.03		51.1
Qwen2.5-VL-3B 2025.06		50.1
InternVL3-2B 2025.12		48.6
InternVL3 2025.12		48.6
LLaVA + GMAIL 2026.02		48.3
SAIL-VL2 2025.12		47.7
AndesVL 2025.12		46.1
Qwen3-VL-2B 2025.11		45.78
jina-vlm 2025.12		45.6
LFM2-VL-3B 2025.11		45.33
LLaVA 2026.02		44.7
HyperVL ViTL 2025.12		44.6
IADA +LoRA 2026.03		44.4
HyperVL 2025.12		43.4
SAIL-VL1.5 2025.12		42.9
AttnRes+LoRA 2026.03		42.2
SmolVLM2-2.2B 2025.11		41.6

Showing 100 of 130 rows