Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Video Understanding on MLVU (M-Avg and Relative M-Avg)
Loading...
70.2
M-Avg
Vanilla
65.52
66.735
67.95
69.165
Dec 9, 2024
M-Avg
Relative M-Avg
Updated 2mo ago
Evaluation Results
Method
Method
Links
M-Avg
Relative M-Avg
Vanilla
Backbone=Qwen2.5-VL 7B...
2024.12
70.2
100
iLLaVA
Backbone=Qwen2.5-VL 7B...
2024.12
69.8
98.6
iLLaVA
Backbone=Qwen2.5-VL 7B...
2024.12
69.3
97.8
VisionZip
Backbone=Qwen2.5-VL 7B...
2024.12
69
97.3
PyramidDrop
Backbone=Qwen2.5-VL 7B...
2024.12
68.4
96.9
FasterVLM
Backbone=Qwen2.5-VL 7B...
2024.12
68.2
96.6
FasterVLM
Backbone=Qwen2.5-VL 7B...
2024.12
67.1
95.5
VisionZip
Backbone=Qwen2.5-VL 7B...
2024.12
67.1
95.4
PyramidDrop
Backbone=Qwen2.5-VL 7B...
2024.12
67
95.1
SparseVLM
Backbone=Qwen2.5-VL 7B...
2024.12
66.9
95.3
SparseVLM
Backbone=Qwen2.5-VL 7B...
2024.12
65.7
93.5
Feedback
Search any
task
Search any
task
