Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Video Question Answering on VideoMME (Length Breakdown, ER, CS Metrics)
Loading...
76.7
Accuracy (Short Length)
Qwen2.5-VL-7B
66.612
69.231
71.85
74.469
Mar 5, 2026
Accuracy (Short Length)
Accuracy (Medium Length)
Accuracy (Long Length)
Overall Accuracy
VideoMME Accuracy (%)
ER (Error Metric)
CS Score
Updated 1mo ago
Evaluation Results
Method
Method
Links
Accuracy (Short Length)
Accuracy (Medium Length)
Accuracy (Long Length)
Overall Accuracy
VideoMME Accuracy (%)
ER (Error Metric)
CS Score
Qwen2.5-VL-7B
Size=7B, Tokens (#)=13...
2026.03
76.7
68.2
56.9
67.3
100
1
66.3
FastVID
Size=7B, Tokens (#)=32...
2026.03
74.3
61.3
52.8
62.8
93.3
5.2
33
SemVID
Size=7B, Tokens (#)=32...
2026.03
73.8
62.8
52.4
63.1
93.7
5.4
30.7
PruneVID
Size=7B, Tokens (#)=32...
2026.03
67
59.4
51.6
59.3
88.1
-
-
Feedback
Search any
task
Search any
task