Video Question Answering on VideoMME (Length Breakdown, ER, CS Metrics)
76.7Accuracy (Short Length)
Qwen2.5-VL-7B
Updated 1mo ago
Evaluation Results
| Method | Links | ||||||||
|---|---|---|---|---|---|---|---|---|---|
2026.03 | 76.7 | 68.2 | 56.9 | 67.3 | 100 | 1 | 66.3 | - | |
2026.03 | 74.3 | 61.3 | 52.8 | 62.8 | 93.3 | 5.2 | 33 | - | |
2026.03 | 73.8 | 62.8 | 52.4 | 63.1 | 93.7 | 5.4 | 30.7 | - | |
2026.04 | 71.22 | 56.22 | 48.61 | - | - | - | - | - | |
2026.04 | 67.89 | 56.78 | 48 | - | - | - | - | 1.31 | |
2026.04 | 67.89 | 55.67 | 48.89 | - | - | - | - | 0.95 | |
2026.04 | 67.67 | 54.22 | 49.11 | - | - | - | - | 1.18 | |
2026.04 | 67.33 | 54.89 | 49.33 | - | - | - | - | 1.6 | |
2026.03 | 67 | 59.4 | 51.6 | 59.3 | 88.1 | - | - | - | |
2026.04 | 66.78 | 54.56 | 47.22 | - | - | - | - | 2.32 | |
2026.04 | 66.67 | 55.22 | 48.89 | - | - | - | - | 2.02 | |
2026.04 | 65.89 | 53.56 | 48.11 | - | - | - | - | 3.15 | |
2026.04 | 65.67 | 53.78 | 47.67 | - | - | - | - | 3.34 | |
2026.04 | 65.22 | 54.22 | 48.22 | - | - | - | - | 2.9 | |
2026.04 | 65.11 | 54.56 | 48.11 | - | - | - | - | 3.23 | |
2026.04 | 64.89 | 54.22 | 47.67 | - | - | - | - | 3.17 | |
2026.04 | 64.78 | 54.44 | 47.78 | - | - | - | - | 3.21 | |
2026.04 | 62.55 | 52.67 | 46.67 | - | - | - | - | 5.12 | |
2026.04 | 61 | 52.89 | 45.78 | - | - | - | - | 7.36 |