Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Long video understanding on VideoMME w/o sub
Loading...
87
Accuracy
Gemini 2.5 Pro
44.776
55.738
66.7
77.662
May 11, 2025
Jul 2, 2025
Aug 23, 2025
Oct 14, 2025
Dec 5, 2025
Jan 26, 2026
Mar 20, 2026
Accuracy
Updated 26d ago
Evaluation Results
Method
Method
Links
Accuracy
Gemini 2.5 Pro
Evaluation frame rate=...
2025.05
87
Seed1.5-VL
Thinking mode=true, Ev...
2025.05
77.9
Seed1.5-VL
Thinking mode=false, E...
2025.05
77.6
VideoSeek
#Frames=60.9
2026.03
70.1
GPT-5 (Base)
#Frames=384
2026.03
67.9
Gemini 1.5 Pro
#Frames=1,233
2026.03
67.4
DVD
#Frames=4,932
2026.03
67.3
GPT-4o
#Frames=384
2026.03
65.3
Gemini 2.0 Flash
#Frames=1,233
2026.03
63
MR. Video
#Frames=4,932
2026.03
61.8
VCA
#Frames=18.1
2026.03
54.2
Qwen2.5-VL-72B
#Frames=256
2026.03
53.2
VideoTree
#Frames=98.0
2026.03
53.1
DrVideo
#Frames=493.2
2026.03
51.7
VideoAgent
#Frames=24.6
2026.03
46.4
Feedback
Search any
task
Search any
task