Audio Reasoning on MMAR (test)
67.3Sound Score
Omni-R1
Updated 4d ago
Evaluation Results
| Method | Links | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
2026.04 | 67.3 | 51.5 | 64.3 | 45.5 | 70.2 | 64.6 | 70.8 | 63.4 | - | - | |
2026.04 | 67.3 | 56.8 | 82 | 100 | 84.9 | 80.5 | 66.7 | 74.4 | - | - | |
2026.04 | 66.67 | 53.4 | 79.25 | 90.91 | 79.9 | 76.83 | 79.17 | 71.7 | 62.22 | 87 | |
2026.04 | 64.24 | 50 | 79.25 | 54.55 | 72.48 | 69.51 | 70.83 | 68 | 57.97 | 85 | |
2026.02 | 61.4 | 66.1 | 77.2 | 57.2 | 65.1 | 68.3 | 55.5 | 64.4 | - | - | |
2026.04 | 61.2 | 51 | 72.1 | 81.8 | 72.5 | 65.9 | 70.8 | 65.6 | - | - | |
2026.04 | 60 | 53.4 | 77.2 | 63.6 | 76.2 | 69.5 | 75 | 68.4 | - | - | |
2026.04 | 59.39 | 54.37 | 72.45 | 63.67 | 77.52 | 65.85 | 66.67 | 66.9 | - | - | |
2026.04 | 58.8 | 40.8 | 59.9 | 54.5 | 61.9 | 67.1 | 58.3 | 56.7 | - | - | |
2026.02 | 58.2 | 64.7 | 76.5 | 54.9 | 63.2 | 67.4 | 56.1 | 63 | - | - | |
2026.04 | 56.97 | 45.15 | 59.52 | 45.45 | 67.89 | 59.76 | 41.67 | 57.4 | 45.2 | 79 | |
2026.04 | 53.9 | 51 | 70.4 | 63.6 | 72.5 | 62.2 | 75 | 63.5 | - | - | |
2026.02 | 51.52 | 45.15 | 73.81 | - | - | - | - | 63 | - | - | |
2026.02 | 50.91 | 43.2 | 72.79 | - | - | - | - | 60 | - | - | |
2026.02 | 48.48 | 31.55 | 45.92 | - | - | - | - | 41.3 | - | - | |
2026.02 | 47.27 | 30.1 | 40.82 | - | - | - | - | 38.6 | - | - | |
2026.02 | 46.5 | 54.6 | 67.1 | 44.1 | 50.9 | 54.3 | 45.4 | 51.8 | - | - | |
2026.02 | 46.2 | 54.1 | 66.8 | 43.5 | 50.2 | 53.7 | 44.6 | 51.3 | - | - | |
2026.02 | 45.6 | 55.2 | 68.4 | 42.1 | 51.5 | 55.8 | 46.1 | 52.1 | - | - | |
2026.02 | 43.64 | 35.44 | 67.01 | - | - | - | - | 55 | - | - | |
2026.02 | 42.42 | 30.58 | 61.22 | - | - | - | - | 52.2 | - | - | |
2026.04 | 42.42 | 32.52 | 42.52 | 45.13 | 48.62 | 30.49 | 29.17 | 40.5 | 28.4 | 68 | |
2026.02 | 40 | 25.24 | 37.07 | - | - | - | - | 35.5 | - | - | |
2026.02 | 40 | 27.67 | 40 | - | - | - | - | 37.5 | - | - | |
2026.04 | 38.8 | 35.9 | 58.8 | 45.5 | 60.1 | 57.3 | 60 | 50.6 | - | - | |
2026.02 | 38.79 | 29.61 | 64.29 | - | - | - | - | 49.7 | - | - | |
2026.02 | 37.58 | 22.33 | 38.78 | - | - | - | - | 35.1 | - | - | |
2026.04 | 35.8 | 25.2 | 34 | 9.1 | 30.7 | 30.5 | 37.5 | 31.3 | 19.85 | 62 | |
2026.04 | 33.9 | 23.3 | 33 | 9.1 | 33 | 26.8 | 33.3 | 30.4 | - | - | |
2026.04 | 33.3 | 24.3 | 32.3 | 9.1 | 31.2 | 30.5 | 25 | 30 | - | - | |
2026.04 | 33.3 | 26.7 | 24.8 | 18.2 | 37.2 | 32.9 | 29.2 | 30 | 18.5 | 61 | |
2026.04 | 32.7 | 21.8 | 24.8 | 18.2 | 30.3 | 24.4 | 25 | 26.6 | - | - | |
2026.04 | 32.52 | 32.52 | 68.71 | 45.22 | 72.02 | 62.2 | 72.02 | 58.6 | 46.55 | 79 | |
2026.04 | 30.9 | 29.6 | 34.4 | 9.1 | 37.6 | 28.1 | 37.5 | 32.8 | - | - | |
2026.02 | 29.4 | 25.9 | 31.5 | 25 | 29.3 | 31.1 | 28.1 | 29.3 | - | - | |
2026.04 | 29.39 | 25.88 | 31.48 | 25 | 29.3 | 31.1 | 28.13 | 29.32 | - | - | |
2026.02 | 28.5 | 30.2 | 35.4 | 26.8 | 31 | 32.5 | 28.4 | 30.4 | - | - | |
2026.04 | 24.9 | 17.5 | 20.8 | 18.2 | 26.6 | 23.2 | 8.3 | 21.9 | - | - |