Share your thoughts, 1 month free Claude Pro on usSee more

Audio Understanding on MMAU audio

72.08Sound Score

MiniCPM-O 2.6 + MoD-DPO

Updated 1mo ago

Evaluation Results

Method	Links
MiniCPM-O 2.6 + MoD-DPO 2026.03		72.08	70.08	64.78	68.98
MiniCPM-O 2.6 + MoD-DPO++ 2026.03		71.34	69.23	64.91	68.3
MiniCPM-O 2.6 + OmniDPO 2026.03		70.65	69.15	63.38	67.73
MiniCPM-O 2.6 + DPO 2026.03		69.38	67.13	64.23	66.91
MiniCPM-O 2.6 2026.03		69.23	66.76	64.26	66.75
Qwen 2.5 Omni + MoD-DPO 2026.03		68.21	70.12	58.98	65.77
Qwen 2.5 Omni + MoD-DPO++ 2026.03		68.16	71.6	59.24	66.33
Qwen 2.5 Omni + OmniDPO 2026.03		67.58	69.87	59.11	65.52
Qwen 2.5 Omni + DPO 2026.03		67.23	69.99	58.34	65.19
Qwen 2.5 Omni 2026.03		66.19	68.34	59.32	64.62
Audio-Interaction 2026.06		65.63	57.93	46.68	58.15
Qwen2.5-Omni 2026.06		60.54	50.9	35.11	49.58
Baichuan-Omni-1.5 2026.06		57.53	36.53	24.82	40.4
Qwen2.5-Omni 2026.06		51.81	44.01	29.79	42.51
Voxtral-Mini 2026.06		46.08	34.13	30.5	37.24
Phi-4-multimodal 2026.06		44.65	27.84	21.99	31.75
Qwen2-Audio 2026.06		22.32	19.16	16.31	19.41
Audio-Reasoner 2026.06		20.48	26.65	13.48	20.57
Audio Flamingo 2 2026.06		1.5	1.49	0.35	1.16