Multiple-choice audio understanding on MMAU mini (test)
73.2Average Accuracy
Qwen2.5-Omni
Updated 8d ago
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
2026.04 | 73.2 | 79 | 71 | 69.7 | |
2026.04 | 71.5 | 78.1 | 65.9 | 70.6 | |
2026.04 | 71 | 78.1 | 68 | 67 | |
2026.04 | 70.5 | 71.2 | 65.3 | 75.1 | |
2026.04 | 70.4 | 75.1 | 68.6 | 67.6 | |
2026.04 | 63.8 | 66.1 | 63 | 62.5 | |
2026.04 | 62.5 | 64.6 | 56.3 | 66.7 | |
2026.04 | 62.3 | 65.1 | 61.7 | 60 | |
2026.05 | 56.4 | - | - | - | |
2026.05 | 55.6 | - | - | - | |
2026.05 | 55.4 | - | - | - | |
2026.05 | 55.4 | - | - | - | |
2026.05 | 55.4 | - | - | - | |
2026.04 | 53 | 50.8 | 39.2 | 69.1 | |
2026.05 | 53 | - | - | - | |
2026.05 | 52.3 | - | - | - | |
2026.05 | 51 | - | - | - | |
2026.05 | 50.2 | - | - | - | |
2026.05 | 49.3 | - | - | - | |
2026.05 | 47.7 | - | - | - | |
2026.05 | 47.2 | - | - | - | |
2026.05 | 47.2 | - | - | - | |
2026.05 | 46.6 | - | - | - | |
2026.05 | 43.3 | - | - | - | |
2026.04 | 42.8 | 48.7 | 34.4 | 45.4 | |
2026.05 | 42.7 | - | - | - | |
2026.04 | 41.2 | 46.6 | 33.8 | 43.5 | |
2026.05 | 39.5 | - | - | - | |
2026.04 | 34.9 | 41.1 | 37.1 | 26.4 | |
2026.04 | 22.8 | 30.9 | 26.7 | 10.8 | |
2026.04 | 20.8 | 31.8 | 17.7 | 12.9 | |
2026.04 | 17.4 | 20.4 | 16 | 15.9 | |
2026.04 | 16.6 | 25.2 | 17.7 | 6.9 |