Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

MMAR

Benchmarks

Task NameDataset NameSOTA ResultTrend
Audio UnderstandingMMAR (test)
Performance67.1
20
Audio ReasoningMMAR (test)
Sound Score61.4
17
Audio Question AnsweringMMAR
Sd Score68.48
17
Audio UnderstandingMMAR (comprehensive evaluation)
Sound Score61.21
15
Audio Understanding / Audio ReasoningMMAR
Accuracy61.4
13
Audio UnderstandingMMAR
MMAR74.7
12
Audio ReasoningMMAR
Sound Accuracy73.33
8
Audio ReasoningMMAR N=1,000
Accuracy53.6
5
Audio Understanding & ReasoningMMAR
Score71.9
3
Dense Audio CaptioningMMAR
MMAR Score46.4
3
Audio QAMMAR (test)
Accuracy68.1
2
Showing 11 of 11 rows