Video Question Answering on VideoMMMU
74.9Accuracy
Gemini 2.5 Pro
Updated 1mo ago
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
2026.01 | 74.9 | - | - | |
2026.04 | 68.7 | - | - | |
2026.01 | 66.8 | - | - | |
2026.01 | 65.3 | - | - | |
2026.01 | 65.3 | - | - | |
2026.01 | 65 | 53 | 52 | |
2026.04 | 64.1 | - | - | |
2026.01 | 63 | - | - | |
2026.03 | 63 | - | - | |
2025.06 | 62.9 | - | - | |
2025.06 | 62.1 | - | - | |
2026.04 | 61.22 | - | - | |
2026.02 | 61.2 | - | - | |
2026.01 | 61.2 | - | - | |
2026.04 | 61.2 | - | - | |
2025.06 | 61.1 | - | - | |
2026.01 | 61 | - | 2.2 | |
2026.03 | 61 | - | - | |
2026.03 | 60.8 | - | - | |
2026.01 | 60.2 | - | - | |
2026.03 | 60 | - | - | |
2026.04 | 59.9 | - | - | |
2026.03 | 59.6 | - | - | |
2025.06 | 59.1 | - | - | |
2026.01 | 58.6 | 51 | 44 | |
2026.01 | 58.4 | - | - | |
2026.03 | 58.4 | - | - | |
2026.03 | 58.2 | - | - | |
2026.01 | 57.1 | - | - | |
2026.03 | 56.8 | - | - | |
2025.06 | 56.4 | - | - | |
2026.03 | 56.3 | - | - | |
2026.01 | 56.2 | - | - | |
2026.03 | 56.1 | - | - | |
2026.03 | 55.5 | - | - | |
2026.03 | 55.3 | - | - | |
2026.03 | 55.1 | - | - | |
2026.01 | 54.7 | - | 3 | |
2026.03 | 54.5 | - | - | |
2026.01 | 54.2 | - | - | |
2026.03 | 54.1 | - | - | |
2025.06 | 54 | - | - | |
2026.02 | 53.9 | - | - | |
2026.01 | 53.9 | - | - | |
2026.04 | 53.9 | - | - | |
2026.04 | 53.7 | - | - | |
2026.04 | 53.66 | - | - | |
2026.03 | 53.6 | - | - | |
2026.03 | 53.5 | - | - | |
2026.03 | 53.4 | - | - | |
2025.06 | 53.3 | - | - | |
2026.04 | 53.2 | - | - | |
2025.06 | 53.2 | - | - | |
2026.01 | 52.7 | - | - | |
2026.01 | 52.7 | - | - | |
2026.04 | 52.7 | - | - | |
2026.03 | 52.6 | - | - | |
2026.03 | 52.6 | - | - | |
2026.02 | 52.4 | - | - | |
2026.01 | 52.4 | - | - | |
2026.01 | 52.3 | - | - | |
2026.04 | 52.3 | - | - | |
2026.01 | 52.2 | - | - | |
2026.03 | 52.2 | - | - | |
2026.04 | 52 | - | - | |
2025.06 | 52 | - | - | |
2026.01 | 51.9 | - | - | |
2026.01 | 51.7 | - | - | |
2026.03 | 51.5 | - | - | |
2026.01 | 51.4 | - | 386 | |
2026.04 | 51.4 | - | - | |
2026.02 | 51.3 | - | - | |
2026.03 | 51.3 | - | - | |
2026.01 | 51.2 | - | - | |
2026.03 | 51.2 | - | - | |
2026.02 | 51.1 | - | - | |
2026.01 | 51.1 | - | - | |
2026.03 | 51.1 | - | - | |
2026.04 | 51.1 | - | - | |
2026.04 | 51.1 | - | - | |
2026.04 | 50.8 | - | - | |
2025.06 | 50.6 | - | - | |
2026.04 | 50 | - | - | |
2026.01 | 50 | - | - | |
2025.06 | 50 | - | - | |
2026.01 | 49.8 | - | - | |
2026.04 | 49.78 | - | - | |
2026.01 | 49.6 | - | 133 | |
2026.03 | 49.6 | - | - | |
2026.04 | 49.44 | - | - | |
2026.04 | 49.33 | - | - | |
2025.06 | 49.3 | - | - | |
2026.03 | 49.2 | - | - | |
2026.03 | 49.1 | - | - | |
2026.03 | 49.1 | - | - | |
2026.02 | 48.8 | - | - | |
2026.03 | 48.8 | - | - | |
2026.04 | 48.1 | - | - | |
2026.03 | 48.1 | - | - | |
2026.03 | 47.9 | - | - |
Showing 100 of 166 rows