Share your thoughts, 1 month free Claude Pro on usSee more

Audio Understanding on MMAU

81.1Accuracy

Gemini-3.1-Pro

Updated 1d ago

Evaluation Results

Method	Links
Gemini-3.1-Pro 2026.06		81.1
Gemini-3-Pro 2026.02		80.8
ERNIE 5.0-Base 2026.02		80.8
ERNIE 5.0 2026.02		80.4
Gemini-3-Pro 2026.06		80.15
Step-Audio-R1 2026.06		78.67
Qwen3-Omni-A3B-Instruct 2026.03		78.2
MOSS-Audio-4B-Thinking 2026.06		77.64
Base 2026.05		77.6
Qwen3-Omni-Instruct 2026.02		77.5
MOSS-Audio-8B-Thinking 2026.06		77.33
MOSS-Audio-8B-Instruct 2026.06		77.03
ReGap 2026.05		76.8
ReGap 2026.05		76.8
LongCat-Next 2026.03		76.4
Base 2026.05		76.2
Audio Flamingo Next 2026.06		76.1
LongCat-Flash-Omni 2026.02		75.9
MiMo-Audio 2026.03		75.8
MOSS-Audio-4B-Instruct 2026.06		75.79
Qwen3-Omni-30B-A3B-Instruct 2026.06		75
MiMo-Audio-7B 2026.06		74.9
Gemini-2.5-Flash-Lite-preview 2026.03		74.8
MiMo-Audio + SICL-AT3 2026.01		73.4
MiMo-Audio + SICL-AT2 2026.01		72.9
MiMo-Audio + Vanilla SICL 2026.01		72.6
Kimi-Audio 2026.06		72.41
Step-Audio-R1.1 2026.06		72.18
Qwen2.5-Omni + SICL-AT3 2026.01		72.1
MiMo-Audio + SICL-AT1 2026.01		71.9
Gemini-3.1-Flash-Lite-preview 2026.03		71.7
Step-Audio-2-mini 2026.03		71.3
ShiftDC 2026.05		71.2
Qwen2.5-Omni + SICL-AT2 2026.01		71.1
MiniCPM-o-4.5 2026.06		70.97
Kimi-Audio 2026.03		70.31
Qwen2.5-Omni + SICL-AT1 2026.01		69.6
GPT-4o-Audio 2026.02		68.4
Qwen2.5-Omni + Vanilla SICL 2026.01		67.3
MiMo-Audio 2026.01		66.9
ReGap 2026.05		66.8
Base 2026.05		66
Qwen2.5-Omni 2026.01		65.8
GPT4o-Audio 2026.06		65.66
Qwen2.5-Omni 2026.06		65.6
Qwen2.5-Omni (Fine-tuned on RSR) 2026.01		65.3
Kimi Audio 2026.02		65.2
SPA-VL-DPO 2026.05		64.4
Qwen2.5-Omni (Fine-tuned on CV-en) + Vanilla SICL 2026.01		64.1
VLGuard-SFT 2026.05		64
Qwen2.5-Omni (Fine-tuned on CV-en) 2026.01		63.9
Audio Flamingo 3 2026.06		61.23
ShiftDC 2026.05		29.2
ShiftDC 2026.05		3.2