Share your thoughts, 1 month free Claude Pro on usSee more

General Video Understanding on Video-MME (Accuracy)

87.8Accuracy

Gemini 1.5 Pro

Updated 18d ago

Evaluation Results

Method	Links
Gemini 1.5 Pro 2026.06		87.8
Gemini 1.5 Pro 2026.06		87.5
GPT-4o 2026.06		86.9
Gemini 1.5 Flash 2026.06		84.2
GPT-4o mini 2026.06		82.3
Claude 3.5 Sonnet 2026.06		80.5
SpatialClaw 2026.06		77
Key-VL-1.5-8B 2026.06		76.2
Molmo2-8B 2026.06		75.8
Eagle-X5-7B 2026.06		75.7
GLM-4V-9B 2026.06		75.6
AdaCodec 2026.06		75.5
Qwen2-VL-7B 2026.06		75.2
Gemini-1.5-Pro 2026.05		75
AdaCodec 2026.06		75
Gemini-1.5-Pro 2026.07		75
SpaceTools Toolshed 2026.06		74.6
Gemini-3.1-Pro 2026.05		74.3
MiniCPM-V-2.6-8B 2026.06		73.5
SELECTSTREAM-Qwen3-VL-8B 2026.06		73.2
GPT-5.1 2026.05		72.9
GPT-4o 2026.05		71.9
GPT-4o 2026.07		71.9
Qwen3-VL-8B 2026.06		71.4
LLaVA-Video-7B 2026.06		69.7
VideoChat-Flash-7B 2026.06		69.7
CoPE-VideoLM-7B 2026.06		69.4
Molmo2-O-7B 2026.06		69.2
InternVL2-8B 2026.06		68.6
Streamo-7B 2026.06		67.9
SELECTSTREAM-Qwen2.5-VL-7B 2026.06		67.8
Qwen-2.5-VL 2026.07		66.1
InternVL3-8B 2026.05		65.6
Qwen3-VL-8B + CRPO 2026.05		65.6
TimeThink 2026.07		65.5
PLM-7B 2026.06		65.4
VideoChat-R1.5 2026.07		65.2
Qwen3-VL-8B + ArrowRL 2026.05		65.1
Qwen2.5-VL-7B 2026.06		65.1
Qwen3-VL-8B + T-GRPO 2026.05		65
Qwen3-VL-8B 2026.05		64.9
Qwen3-VL-8B + GRPO 2026.05		64.5
ReMoRa-7B 2026.06		64.4
Qwen2.5-VL-GRPO 2026.07		64.3
InternVL2.5 2026.07		64.2
VideoChat-R1 2026.07		64.1
VideoLatent-7B (Ours) 2026.06		63.8
Qwen2.5-VL-SFT 2026.07		63.6
Qwen3-VL-4B + T-GRPO 2026.05		63.4
Qwen2-VL-7B 2026.06		63.3
LLaVA-Video-7B 2026.06		63.3
Qwen3-VL-4B + CRPO 2026.05		63
Qwen2.5-VL-7B 2026.06		62.7
Qwen3-VL-4B 2026.05		62.2
Qwen3-VL-4B + ArrowRL 2026.05		62.2
Qwen3-VL-4B + GRPO 2026.05		62.1
Mull-Token-7B 2026.06		62.1
LVR-7B 2026.06		62
StreamForest-7B (FT-drive) 2026.06		61.9
StreamForest-7B 2026.06		61.4
VideoLatent-7B (Ours) 2026.06		61.4
Video-R1-7B 2026.06		61.4
Open-o3-Video-7B 2026.06		61.4
Video-R1 2026.07		61.4
Open-o3-Video-7B 2026.06		61.3
STORM 2026.05		61
Qwen2.5-VL-7B-Instruct(CoT) 2026.05		60.8
LongVU-7B 2026.06		60.6
LVR-7B 2026.06		60.5
Qwen2.5-VL-7B 2026.05		60.3
LLaVA-Next-Video 2026.05		60.2
ArrowRL* 2026.05		60.1
VILA-1.5 2026.07		60.1
Video-Thinker-7B 2026.05		60
VideoRFT-7B 2026.06		59.8
VideoRFT 2026.07		59.8
LongVT-RFT 2026.05		59.7
Qwen2.5-VL-7B (CoT) 2026.06		59.6
Mull-Token-7B 2026.06		59.5
GPT-4V 2026.07		59.5
Qwen2.5-VL-7B 2026.06		59.4
VideoLatent-7B (Ours) 2026.06		59.3
Video-R1-7B 2026.06		59.3
LVR-7B 2026.06		59.1
LLaVA-OneVision-7B 2026.06		58.2
LLaVA-OV 2026.07		58.2
LLaVA-OV-7B 2026.05		57.6
Video-R1-7B 2026.05		57.4
Video-R1-7B 2026.06		57.4
Dispider-7B 2026.06		57.2
Mull-Token-7B 2026.06		57
Qwen2.5-VL-7B 2026.06		56.6
Qwen2.5-VL-7B (CoT) 2026.06		56.6
Kangaroo 2026.05		56
VideoRefer 2026.05		55.9
SWIM 2026.05		55.9
LLaVA-Octopus 2026.05		55.7
Qwen2.5-VL-7B-SFT 2026.05		55.4
VideoLLaMA2.1 2026.05		54.9
VideoChat2-HD 2026.05		54.6

Showing 100 of 139 rows