Audio Question Answering on MMAR
70.03Average Score
Gemini-2.5-Pro
Updated 1mo ago
Evaluation Results
| Method | Links | ||||||||
|---|---|---|---|---|---|---|---|---|---|
2026.02 | 70.03 | 66.06 | 57.77 | 73.13 | 81.82 | 71.1 | 69.51 | 70.83 | |
2026.02 | 69.99 | 67.27 | 60.68 | 69.39 | 81.82 | 69.72 | 74.39 | 66.67 | |
2026.02 | 67.9 | 61.21 | 50.97 | 72.11 | 81.82 | 72.48 | 65.85 | 70.83 | |
2026.02 | 67.25 | 68.48 | 53.88 | 64.29 | 72.73 | 71.56 | 73.17 | 66.67 | |
2025.10 | 64.1 | - | - | - | - | - | - | - | |
2025.10 | 64.1 | - | - | - | - | - | - | - | |
2026.02 | 64.09 | 53.94 | 50.97 | 70.41 | 63.64 | 72.48 | 62.2 | 75 | |
2026.02 | 63.46 | 67.3 | 51.5 | 64.3 | 55.5 | 70.2 | 64.6 | 70.8 | |
2025.10 | 59.8 | - | - | - | - | - | - | - | |
2025.10 | 59.8 | - | - | - | - | - | - | - | |
2025.10 | 59.3 | - | - | - | - | - | - | - | |
2025.10 | 59.3 | - | - | - | - | - | - | - | |
2025.10 | 58.2 | - | - | - | - | - | - | - | |
2025.10 | 58.2 | - | - | - | - | - | - | - | |
2026.02 | 57.33 | 58.79 | 40.78 | 59.86 | 54.55 | 61.93 | 67.07 | 58.33 | |
2025.10 | 51.8 | - | - | - | - | - | - | - | |
2025.10 | 51.8 | - | - | - | - | - | - | - | |
2025.10 | 50.7 | - | - | - | - | - | - | - | |
2025.10 | 50.7 | - | - | - | - | - | - | - | |
2025.10 | 50.6 | - | - | - | - | - | - | - | |
2025.10 | 50.6 | - | - | - | - | - | - | - | |
2026.02 | 49.49 | 38.79 | 35.92 | 58.84 | 45.45 | 60.09 | 57.32 | 50 | |
2025.10 | 44.2 | - | - | - | - | - | - | - | |
2025.10 | 44.2 | - | - | - | - | - | - | - | |
2025.10 | 42.5 | - | - | - | - | - | - | - | |
2025.10 | 42.5 | - | - | - | - | - | - | - | |
2026.02 | 40.05 | 41.21 | 33.01 | 40.48 | 36.36 | 48.62 | 39.02 | 41.67 | |
2026.02 | 36.42 | 43.64 | 33.5 | 32.99 | 45.45 | 42.66 | 31.71 | 25 | |
2026.02 | 31.01 | 30.3 | 31.07 | 34.69 | 9.09 | 34.86 | 35.37 | 41.67 | |
2026.02 | 28.97 | 35.76 | 25.24 | 34.01 | 9.09 | 30.73 | 30.49 | 37.5 | |
2026.02 | 28.61 | 29.39 | 25.88 | 31.48 | 25 | 29.3 | 31.1 | 28.13 | |
2026.02 | 26.53 | 33.33 | 24.27 | 32.31 | 9.09 | 31.19 | 30.49 | 25 | |
2026.02 | 24.83 | 29.09 | 24.27 | 27.89 | 27.27 | 24.77 | 28.05 | 12.5 | |
2026.02 | 21.59 | 27.88 | 20.39 | 22.11 | 9.09 | 25.23 | 25.61 | 20.83 | |
2026.02 | 19.91 | 24.85 | 17.48 | 20.75 | 18.18 | 26.61 | 23.17 | 8.33 |