Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Speech Understanding on MMSU
Loading...
81.3
Accuracy
Gemini-3.1-Pro
53.6776
60.8488
68.02
75.1912
Jun 1, 2026
Accuracy
Updated 1d ago
Evaluation Results
Method
Method
Links
Accuracy
Gemini-3.1-Pro
Size=–, Model Category...
2026.06
81.3
Gemini-3-Pro
Size=–, Model Category...
2026.06
81.28
MOSS-Audio-8B-Thinking
Size=8B, Model Categor...
2026.06
75.52
Step-Audio-R1
Size=33B, Model Catego...
2026.06
75.18
MOSS-Audio-4B-Thinking
Size=4B, Model Categor...
2026.06
71.2
Qwen3-Omni-30B-A3B-Instruct
Size=30B, Model Catego...
2026.06
69
MOSS-Audio-8B-Instruct
Size=8B, Model Categor...
2026.06
66.36
Step-Audio-R1.1
Size=33B, Model Catego...
2026.06
64.18
MiMo-Audio-7B
Size=7B, Model Categor...
2026.06
61.94
Qwen2.5-Omni
Size=7B, Model Categor...
2026.06
61.32
MiniCPM-o-4.5
Size=9B, Model Categor...
2026.06
60.96
Audio Flamingo 3
Size=7B, Model Categor...
2026.06
60.04
MOSS-Audio-4B-Instruct
Size=4B, Model Categor...
2026.06
59.68
GPT4o-Audio
Size=–, Model Category...
2026.06
58.76
Audio Flamingo Next
Size=8B, Model Categor...
2026.06
57.2
Kimi-Audio
Size=7B, Model Categor...
2026.06
54.74
Feedback
Search any
task
Search any
task