Multiple-Choice Video QA on VideoMME
75Accuracy
Gemini 1.5 Pro
Updated 1mo ago
Evaluation Results
| Method | Links | ||
|---|---|---|---|
2024.06 | 75 | 81.3 | |
2024.06 | 71.9 | 77.2 | |
2024.06 | 70.3 | 75 | |
2024.06 | 66.3 | 69.6 | |
2024.06 | 62.3 | 64.1 | |
2024.06 | 61.4 | 63.1 | |
2024.06 | 60.2 | 63 | |
2024.06 | 59.9 | 63.3 | |
2024.06 | 54.9 | 56.4 | |
2024.06 | 47.9 | 50.3 | |
2024.06 | 47.9 | 49.7 | |
2024.06 | 45.1 | 46.6 | |
2024.06 | 39.9 | 41.6 | |
2024.06 | 33.7 | - | |
2024.06 | 25.9 | - |