Our new X account is live! Follow @wizwand_team for updates
Home
/
Benchmarks
Audio Question Answering on MMAU-style Complex QA
Loading...
85.7
Accuracy
Speech-Hands
58.8576
65.8263
72.795
79.7637
Jan 14, 2026
Accuracy
Average Accuracy
Updated 4d ago
Evaluation Results
Method
Method
Links
Accuracy
Average Accuracy
Speech-Hands
mode=parallel agentic,...
2026.01
85.7
77.37
Speech-Hands
mode=parallel agentic,...
2026.01
83.34
75.75
Qwen2.5-Omni
setting=GRPO with exte...
2026.01
82.15
75.1
AudioFlamingo 3 (AF3)
2026.01
81.26
74.49
Qwen2.5-Omni
setting=GRPO with offi...
2026.01
79.12
65.54
Qwen2.5-Omni
setting=GER: => AF3 (c...
2026.01
77.48
68.93
Qwen2.5-Omni
setting=SFT with offic...
2026.01
76.61
63.13
Gemini-2-Flash
2026.01
59.89
56.61
Qwen2.5-Omni
2026.01
59.89
57.87
Feedback
Search any
task
Search any
task