Share your thoughts, 1 month free Claude Pro on usSee more

Multi-modal Video Evaluation on Video-MME

75Accuracy

Gemini-1.5-pro

Updated 1mo ago

Evaluation Results

Method	Links
Gemini-1.5-pro 2025.12		75
GPT-4o 2025.12		71.9
Qwen3-VL-4B 2025.12		69.3
FrameOracle 2025.10		69.1
Streamo-4B 2025.12		68.7
Streamo-7B 2025.12		67.9
FrameOracle 2025.10		67.3
Qwen3-VL-8B 2025.10		66.9
Video-XL-2-8B 2025.10		66.6
MACD 2026.02		66
StreamingVLM-7B 2025.12		65.1
Qwen2.5-VL-7B 2025.12		65.1
MACD 2026.02		64
Baseline 2026.02		64
Video-XL-7B 2025.10		64
MACD 2026.02		62
Streamo-3B 2025.12		61.8
FrameOracle 2025.10		61.8
FrameOracle 2025.10		61.6
Qwen2.5-VL-3B 2025.12		61.5
FrameOracle 2025.10		61.4
Flash-VStream-7B 2025.12		61.2
VideoLLaMA3-7B 2025.10		61.2
Streamo-2B 2025.12		60.1
VCD 2026.02		60
LLaVA-Video-7B 2025.10		59.8
FrameOracle 2025.10		59.7
FrameOracle 2025.10		59.6
MACD 2026.02		59
InternVL3-2B 2025.12		58.9
FrameOracle 2025.10		58.5
Qwen2.5-VL-3B 2025.10		58.4
FrameOracle 2025.10		58.1
Dispider-7B 2025.12		57.2
LLaVA-OneVision-7B 2025.10		56.1
SID 2026.02		56
SID 2026.02		56
FrameOracle 2025.10		56
Baseline 2026.02		54
VCD 2026.02		54
SID 2026.02		52
SID 2026.02		51
VCD 2026.02		51
Baseline 2026.02		51
MACD 2026.02		49
Baseline 2026.02		48
VideoLLaMA2-7B 2025.10		47.9
Baseline 2026.02		46
MACD 2026.02		46
SID 2026.02		46
Baseline 2026.02		45
VCD 2026.02		44
VCD 2026.02		44
VCD 2026.02		44
SID 2026.02		43
VideoChat2-7B 2025.10		39.5
VideoLLM-online-8B 2025.12		26.9