Share your thoughts, 1 month free Claude Pro on usSee more

Multimodal Understanding on MMMU (Score)

81.8MMMU Score

GPT-5-Thinking

Updated 8d ago

Evaluation Results

Method	Links
GPT-5-Thinking 2025.09		81.8
Gemini 2.5 Flash 2026.04		76.3
Gemini-2.5-Pro 2025.09		74.7
InternVL3.5 2026.04		73.4
Audio Flamingo3 2026.04		72.42
Ming-Omni 2026.04		70.8
LongCat-Next 2026.03		70.6
Qwen3-VL 2026.04		69.6
Qwen3-Omni 2026.04		69.1
NEO-unify 2026.03		68.9
MiniCPM-o 4.5 2026.04		67.6
Qwen2.5-Omni-3B 2026.04		63.3
Audio-Omni 2026.04		63.3
VAPO-Thinker-7B 2025.09		60.2
VLAA-Thinker-7B 2025.09		59.1
Lumina 2026.03		58.6
UniWorld-V1 2026.03		58.6
UniWorld-V1 2025.11		58.6
Qwen2.5-VL 2025.05		58.6
Vision-R1-7B 2025.09		57.6
Qwen2-Audio-Instruct 2026.04		57.4
InternVL2.5-8B 2025.09		56.2
InternVL2.5 2025.05		56
VAPO-Thinker-3B 2025.09		55.6
BAGEL 2026.03		55.3
BAGEL 2025.11		55.3
InternVL-U 2026.03		54.7
R1-OneVision-7B 2025.09		54.3
Bagel+LatentUMM 2026.05		53.2
OmniGen2 2026.03		53.1
OminiGen2 2025.11		53.1
Bagel+UniCot 2026.05		53.1
Qwen2.5-VL-7B 2025.09		52.7
Bagel+UniGame 2026.05		52.4
Bagel+RecA 2026.05		52.3
Bagel 2026.05		51.9
Bagel+SFT 2026.05		51.9
Ovis-U1 2026.03		51.1
BLIP3-o 2026.03		50.6
BLIP3-o 2025.11		50.6
Show-o2 2026.03		48.9
LLaVA-OneVision 2025.05		48.8
Show-O2 2026.05		47.9
Slot-MLLM (14B) 2025.05		46.7
Omnigen2 2026.05		46
Mogao 2026.03		44.2
UniGame 2025.11		43.8
TokenFlow-XL 2025.11		43.2
OneCAT 2026.03		41.9
Qwen2-VL-2B 2026.05		41.7
SFT 2025.11		41.2
Janus-Pro 2026.03		41
Janus-Pro† 2025.11		41
Janus Pro 2026.05		40.7
VEN-VL 2026.05		39.7
MiniCPM-V2 2026.05		39.6
TokenFlow-XL 2025.09		38.7
ILLUME 2025.09		38.2
VEN-VL 2026.05		37.9
Show-O2 2026.05		37.1
TinyLLaVA† 2026.05		37
Janus-Pro-1B 2025.09		36.3
VisionZip 2026.05		36.2
Qwen-VL-Chat 2026.05		35.9
LLaVA-NeXT 2025.05		35.8
RecA 2025.11		35.7
SEED-X 2025.11		35.6
VEN-VL 2026.05		35.6
LLaVA-v1.5 2025.09		35.4
Ours 2025.09		35.4
PinPoint 2026.03		35
InternVL2-2B 2026.05		34.9
LLaVA-1.5 2026.05		34.4
FUDOKI 2025.09		34.3
PDrop 2026.03		34.11
Vanilla 2026.03		34.1
TinyLLaVA† 2026.05		34.1
FastV 2026.05		34
TinyLLaVA† 2026.05		33.6
FastV 2026.03		33.56
Slot-MLLM (7B) 2025.05		33.2
SparseVLM 2026.05		32.7
Mini-Gemini-2B 2026.05		31.7
Emu3 2025.11		31.6
Emu3-Chat 2025.09		31.6
TinyLLaVA† 2026.05		31.6
Emu3 2026.05		31.4
LLaVA-Phi-1.5 2025.09		30.7
Janus 2025.09		30.5
Emu3.5 2026.05		29.2
Janus Flow 2026.05		29
MMaDA 2026.05		28.9
Janus 2026.05		27.3
Show-o 2025.11		26.7
Show-o-512 2025.09		26.7
Gemini-Nano-1 2025.09		26.3
Show-O 2026.05		26.1
Show-o-256 2025.09		25.1
Chameleon 2025.11		22.4
Chameleon 2025.09		22.4

Showing 100 of 102 rows