Long Video Understanding on Video-MME long 1.0
67.4Accuracy (No Subs)
Gemini 1.5 Pro
Updated 3d ago
Evaluation Results
| Method | Links | ||
|---|---|---|---|
2024.06 | 67.4 | 77.4 | |
2024.12 | 67.4 | 77.4 | |
2024.09 | 67.4 | 77.4 | |
2024.06 | 65.3 | 72.1 | |
2024.12 | 65.3 | 72.1 | |
2024.09 | 65.3 | 72.1 | |
2024.12 | 63.1 | 63.3 | |
2024.06 | 62.2 | 74.3 | |
2024.06 | 61.1 | 68.8 | |
2024.12 | 60.2 | 63.5 | |
2024.06 | 60 | 62.4 | |
2024.09 | 60 | 62.4 | |
2024.09 | 59.1 | 69.7 | |
2024.06 | 58.6 | 63.4 | |
2024.12 | 58.3 | 62.4 | |
2024.12 | 57.6 | 61.2 | |
2024.09 | 53.9 | 58 | |
2024.09 | 53.8 | 55.7 | |
2024.06 | 53.5 | 56.9 | |
2024.12 | 53.5 | 56.9 | |
2024.09 | 53.5 | 56.9 | |
2024.12 | 53.4 | 55.3 | |
2024.06 | 51.7 | 71.7 | |
2024.06 | 51.2 | 54.7 | |
2024.09 | 51.2 | 58.3 | |
2024.12 | 50.3 | 55.8 | |
2024.09 | 50.3 | 55.8 | |
2024.06 | 48.6 | 50.9 | |
2024.12 | 46.7 | 49.9 | |
2024.09 | 46.7 | 49.9 | |
2024.12 | 46.6 | 49.3 | |
2024.09 | 46.6 | 49.3 | |
2024.06 | 46.2 | 47.6 | |
2024.12 | 46.2 | 47.6 | |
2024.09 | 46.2 | 47.6 | |
2024.06 | 45.4 | 67.7 | |
2024.12 | 44.5 | 46.1 | |
2024.12 | 42.1 | 43.8 | |
2024.09 | 42.1 | 43.8 | |
2024.06 | 40.2 | 44.4 | |
2024.12 | 39.9 | 41.6 | |
2024.12 | 39.7 | - | |
2024.09 | 39.7 | - | |
2024.12 | 37.8 | 37.9 | |
2024.12 | 35 | 37.9 | |
2024.06 | - | 68.5 |