Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Long Video Understanding on MLVU 2024 (test)
Loading...
54.9
Accuracy
GPT-4o
29.108
35.804
42.5
49.196
Aug 28, 2025
Accuracy
Updated 2d ago
Evaluation Results
Method
Method
Links
Accuracy
GPT-4o
Size=-, Frames=0.5 fps...
2025.08
54.9
Video-MTR
Size=7B, Frames=80
2025.08
50.4
Video-MTR
Size=7B, Frames=64
2025.08
49.8
Video-MTR
Size=7B, Frames=32
2025.08
48.4
Video-R1
Size=7B, Frames=64
2025.08
47.6
VideoLLaMA2
Size=8×7B, Frames=8
2025.08
45.6
Video-XL
Size=7B, Frames=128 / 256
2025.08
45.6
Video-R1
Size=7B, Frames=32
2025.08
45.4
Qwen2.5-VL-7B
Size=7B, Frames=80
2025.08
45.2
Video-CCAM
Size=9B, Frames=96
2025.08
42.9
Qwen2.5-VL-7B
Size=7B, Frames=64
2025.08
41.8
Qwen2.5-VL-7B
Size=7B, Frames=32
2025.08
41.6
LongVA
Size=7B, Frames=128 / 256
2025.08
41.1
Video-LLaVA
Size=7B, Frames=8
2025.08
30.7
VideoChat2
Size=7B, Frames=16
2025.08
30.1
Feedback
Search any
task
Search any
task