MMAU
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Audio Understanding | MMAU v05.15.25 (test) | Sound Score84.04 | 28 | |
| Audio Understanding | MMAU v05.15.25 (test-mini) | Sound Score84.04 | 28 | |
| Audio Understanding | MMAU (test) | Speech Score76.58 | 25 | |
| Audio Understanding | MMAU | Accuracy80.8 | 20 | |
| Audio Reasoning | MMAU mini 1.0 (test) | Sound Score83.48 | 15 | |
| Audio Generation | MMAU Speech (Noise) | GSR80 | 15 | |
| Audio Generation | MMAU Speech (Clean) | GSR99 | 15 | |
| Audio Generation | MMAU Sound (Noise) | GSR78.33 | 15 | |
| Audio Generation | MMAU Sound (Clean) | GSR99.67 | 15 | |
| Audio Generation | MMAU Music (Noise) | GSR85 | 15 | |
| Audio Generation | MMAU Music (Clean) | GSR99 | 15 | |
| Paralinguistic | MMAU (test) | Performance74.77 | 12 | |
| Audio Reasoning | MMAU-Pro | Sound55.9 | 11 | |
| Audio Reasoning | MMAU mini (test) | Sound Score66.97 | 10 | |
| Audio Question Answering | MMAU-style Complex QA | Accuracy85.7 | 9 | |
| Massive Multi-discipline Audio Understanding | MMAU | Speech Score69.23 | 9 | |
| Audio Understanding | MMAU Pro (test) | Performance59.2 | 8 | |
| multi-task audio reasoning | MMAU mini | Sound Score0.742 | 7 | |
| Audio Understanding & Reasoning | MMAU-Pro | Score62.9 | 3 | |
| Audio Understanding & Reasoning | MMAU Speech | Score79.3 | 3 | |
| Audio Understanding & Reasoning | MMAU Music | Score73.8 | 3 | |
| Audio Understanding & Reasoning | MMAU Sound | Score79.7 | 3 | |
| Audio Understanding & Reasoning | MMAU | MMAU Score75.9 | 3 | |
| Dense Audio Captioning | MMAU | MMAU Score0.5668 | 3 | |
| Audio Understanding | MMAU Mini | MMAU-Mini Score0.745 | 3 |
Showing 25 of 26 rows