| Dataset Name | SOTA Method | Metric | Trend | ||
|---|---|---|---|---|---|
| MMAR (test) | Omni-R1 | Sound Score67.3 | 38 | 4d ago | |
| MMAU-Pro | AudioToolAgent | Average Score61.9 | 18 | 9d ago | |
| MMAU mini (test) | Omni-R1 | Average Score77.7 | 17 | 9d ago | |
| MMAR | AudioToolAgent | Average Accuracy77 | 15 | 9d ago | |
| MMAU mini 1.0 (test) | Step-Audio 2 | Sound Score83.48 | 15 | 1mo ago | |
| MMAU v05.15.25 (base) | SAM+OR-780M | Sound Accuracy59.73 | 10 | 1mo ago | |
| MMAU v05.15.25 (mini) | SAM+OR-2.7B | Sound Score61.86 | 10 | 1mo ago | |
| SAKURA | Qwen2-Audio-Instruct | Single Score81.2 | 8 | 1mo ago | |
| MMAR Agent Track | Accuracy77.4 | 8 | 1mo ago | ||
| MMSU | OmniJigsaw | Accuracy (Audio Reasoning)70.7 | 7 | 9d ago | |
| MMAR N=1,000 | CoFi-Agent | Accuracy53.6 | 5 | 1mo ago | |
| CompA R (test) | AF-Next-Instruct | Accuracy98.7 | 2 | 5d ago |