Share your thoughts, 1 month free Claude Pro on usSee more

Video Reasoning on Video-MMMU

84.6Accuracy

GPT-5

Updated 11d ago

Evaluation Results

Method	Links
GPT-5 2026.01		84.6
Gemini-2.5-Pro 2026.01		83.6
Seed1.5-VL 2025.05		81.4
Kimi-K1.6 2025.05		76.7
Seed1.5-VL 2025.05		72.1
GPT-4o 2026.01		61.2
GPT-4o 2026.01		61.2
GPT-4o 2026.04		61.2
RLER 2026.04		54.2
Gemini-1.5-Pro 2026.01		53.9
Gemini-1.5-Pro 2026.01		53.4
Video-KTR 2026.01		53.1
Video-RTS 2026.01		52.7
Video-KTR 2026.01		52.6
Video-R1 2026.01		52.3
Video-R1 2026.04		52.3
DPS (Ours) 2026.01		51.6
VideoChat-R1.5 2026.04		51.4
TW-GRPO 2026.01		51.3
Video-KTR 2026.01		51.3
VideoRFT 2026.01		51.1
VideoRFT 2026.04		51.1
MOSS-ChatV 2026.04		50.2
Two-stage RL (Ours) 2026.01		50.1
VideoChat-R1 2026.04		50
VideoR1 2026.01		49.8
Qwen2.5-VL-SFT 2026.01		49.4
Qwen2.5-VL-SFT 2026.01		49.4
STAR-R1 2026.04		49.2
DAPO (Ours) 2026.01		49
Qwen2.5-VL 2026.01		47.4
Qwen2.5-VL-SFT 2026.01		47.4
Qwen2.5-VL-7B 2026.04		47.4
VideoLLaMA 3-7B 2026.04		46
Qwen2.5-VL 2026.01		45.8
TW-GRPO 2026.01		40.8
LLaVA-Video-7B 2026.04		36.1
InternVL2.5 2026.01		35.2
LLaVA-OV 2026.01		33.8
VILA-1.5 2026.01		33.8
LLaVA-OneVision-7B 2026.04		33.8
mPLUG-Owl3 2026.01		32
LLaVA-NeXT-Interleave 2026.01		23.2
VILA-1.5-8B 2026.04		20.9
Mantis-Idefics2 2026.01		19.3