Share your thoughts, 1 month free Claude Pro on usSee more

Multimodal Video Evaluation on Video-MME Sub (test)

87.8Accuracy

Gemini 2.5 Pro

Updated 19d ago

Evaluation Results

Method	Links
Gemini 2.5 Pro 2026.03		87.8
Gemini 3 Pro 2026.03		87.5
GPT-5 2026.03		86.9
Gemini 2.5 Flash 2026.03		84.2
GPT-5 mini 2026.03		82.3
Claude Sonnet 4.5 2026.03		80.5
MolmoPoint-8B 2026.03		76.9
Keye-VL-1.5-8B 2026.03		76.2
Molmo2-8B 2026.03		75.8
Eagle2.5-8B 2026.03		75.7
Molmo2-4B 2026.03		75.7
GLM-4.1V-9B 2026.03		75.6
Qwen3-VL-8B 2026.03		75.2
Qwen3-VL-4B 2026.03		74
MiniCPM-V-4.5-8B 2026.03		73.5
LLaVA-Video-7B 2026.03		69.7
VideoChat-Flash-7B 2026.03		69.7
Molmo2-O-7B 2026.03		69.2
InternVL3.5-4B 2026.03		68.6
InternVL3.5-8B 2026.03		68.6
PLM-8B 2026.03		65.4
PLM-3B 2026.03		59.4