MMAU
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Audio Understanding | MMAU v05.15.25 (test) | Sound Score84.04 | 53 | |
| Audio Understanding | MMAU v05.15.25 (test-mini) | Sound Score84.04 | 44 | |
| Audio Understanding | MMAU | Accuracy80.8 | 27 | |
| Multimodal Audio Understanding | MMAU mini v05.15.25 (test) | Sound Accuracy79.6 | 25 | |
| Audio Understanding | MMAU (test) | Speech Score76.58 | 25 | |
| Audio Understanding | MMAU mini original (test) | Accuracy (Sound Domain)80.78 | 21 | |
| Audio Question Answering | MMAU | Score70 | 18 | |
| Audio Reasoning | MMAU-Pro | Average Score61.9 | 18 | |
| Audio Reasoning | MMAU mini (test) | Average Score77.7 | 17 | |
| Massive Multi-discipline Audio Understanding | MMAU | Speech Score69.23 | 17 | |
| Omni-modal reasoning | MMAU mini v05.15.25 (test) | Overall Score75.5 | 15 | |
| Audio Reasoning | MMAU mini 1.0 (test) | Sound Score83.48 | 15 | |
| Audio Generation | MMAU Speech (Noise) | GSR80 | 15 | |
| Audio Generation | MMAU Speech (Clean) | GSR99 | 15 | |
| Audio Generation | MMAU Sound (Noise) | GSR78.33 | 15 | |
| Audio Generation | MMAU Sound (Clean) | GSR99.67 | 15 | |
| Audio Generation | MMAU Music (Noise) | GSR85 | 15 | |
| Audio Generation | MMAU Music (Clean) | GSR99 | 15 | |
| Paralinguistic | MMAU (test) | Performance74.77 | 12 | |
| Speech Reasoning | MMAU Speech mini | Speech Score75.08 | 11 | |
| Audio Multiple-Choice Question Answering | MMAU mini 1,000 examples (test) | Accuracy69.4 | 10 | |
| Audio Reasoning | MMAU v05.15.25 (base) | Sound Accuracy59.73 | 10 | |
| Audio Reasoning | MMAU v05.15.25 (mini) | Sound Score61.86 | 10 | |
| Audio Understanding | MMAU audio | Sound Score72.08 | 10 | |
| Audio Understanding | MMAU v05.15.25 | Sound Score79.3 | 9 |
Showing 25 of 41 rows