Audio Understanding on MMAR (test)

67.1Performance

Qwen3-Omni-Instruct

Updated 1mo ago

Evaluation Results

Method	Links
Qwen3-Omni-Instruct 2026.02		67.1
Gemini 2.5 Flash 2025.12		65.6
MiMo-Audio-7B-Instruct 2025.12		63.6
GPT-4o-Audio 2025.12		63.5
Step-Audio-2-mini 2026.02		61.57
Audio Flamingo 3 2026.02		61
Audio Flamingo 3 2025.12		58.5
Kimi-Audio-7B-Instruct 2026.02		57.4
Qwen2.5-Omni 2025.12		56.7
Eureka-Audio-Instruct w DataFlux 2026.02		56.2
Step-Audio2-mini 2025.12		55.8
Eureka-Audio-Instruct w/o DataFlux 2026.02		50.7
Qwen2.5-Omni-7B 2026.02		49.6
Kimi-Audio-Instruct 2025.12		48
MiniCPM-o 2026.02		47.9
Eureka-Audio-Base 2026.02		46.8
Ming-Lite-Omni-1.5 2026.02		45.4
Qwen2.5-Omni-3B 2026.02		43.4
Qwen2-Audio 2026.02		37.9
GLM-4-Voice 2025.12		29.5