Multiple-choice audio understanding on MMAU mini (test)
78.4Average Accuracy
SpectCount (Audio Flamingo 3)
Updated 1mo ago
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| 78.4 | 83.18 | 77.54 | 74.47 | ||
2026.06 | 73.9 | 81.08 | 71.86 | 68.77 | |
2026.06 | 73.3 | 79.58 | 73.95 | 66.37 | |
2026.04 | 73.2 | 79 | 71 | 69.7 | |
2026.04 | 71.5 | 78.1 | 65.9 | 70.6 | |
2026.04 | 71 | 78.1 | 68 | 67 | |
2026.04 | 70.5 | 71.2 | 65.3 | 75.1 | |
2026.04 | 70.4 | 75.1 | 68.6 | 67.6 | |
2026.04 | 63.8 | 66.1 | 63 | 62.5 | |
| 63.6 | 70.57 | 58.38 | 61.86 | ||
2026.04 | 62.5 | 64.6 | 56.3 | 66.7 | |
2026.04 | 62.3 | 65.1 | 61.7 | 60 | |
2026.06 | 59.6 | 67.27 | 56.29 | 55.26 | |
2026.06 | 58.2 | 66.67 | 57.19 | 50.75 | |
2026.05 | 56.4 | - | - | - | |
2026.05 | 55.6 | - | - | - | |
2026.05 | 55.4 | - | - | - | |
2026.05 | 55.4 | - | - | - | |
2026.05 | 55.4 | - | - | - | |
2026.04 | 53 | 50.8 | 39.2 | 69.1 | |
2026.05 | 53 | - | - | - | |
2026.05 | 52.3 | - | - | - | |
2026.05 | 51 | - | - | - | |
2026.05 | 50.2 | - | - | - | |
2026.05 | 49.3 | - | - | - | |
2026.05 | 47.7 | - | - | - | |
2026.05 | 47.2 | - | - | - | |
2026.05 | 47.2 | - | - | - | |
2026.05 | 46.6 | - | - | - | |
2026.05 | 43.3 | - | - | - | |
2026.04 | 42.8 | 48.7 | 34.4 | 45.4 | |
2026.05 | 42.7 | - | - | - | |
2026.04 | 41.2 | 46.6 | 33.8 | 43.5 | |
2026.05 | 39.5 | - | - | - | |
2026.04 | 34.9 | 41.1 | 37.1 | 26.4 | |
2026.04 | 22.8 | 30.9 | 26.7 | 10.8 | |
2026.04 | 20.8 | 31.8 | 17.7 | 12.9 | |
2026.04 | 17.4 | 20.4 | 16 | 15.9 | |
2026.04 | 16.6 | 25.2 | 17.7 | 6.9 |