Share your thoughts, 1 month free Claude Pro on usSee more

Audio Question Answering on MMAU

70Score

Gemini 2.5 Pro

Updated 1mo ago

Evaluation Results

Method	Links
Gemini 2.5 Pro 2025.10		70
Audio-Captioner-7B 2025.10		70
Gemini 2.5 Pro 2025.10		70
Audio-Captioner-7B 2025.10		70
Gemini 2.5 Flash 2025.10		65.6
Gemini 2.5 Flash 2025.10		65.6
Qwen2.5-Omni-7B 2025.10		65.2
Qwen2.5-Omni-7B 2025.10		65.2
Qwen2-Audio-7B 2025.10		63.3
Qwen2-Audio-7B 2025.10		63.3
GPT-4o Audio 2025.10		62.4
GPT-4o Audio 2025.10		62.4
MiDashengLM-7B 2025.10		59.4
MiDashengLM-7B 2025.10		59.4
Gemini 2.0 Flash 2025.10		58.6
Gemini 2.0 Flash 2025.10		58.6
SALMONN-13B 2025.10		58.36
SALMONN-13B 2025.10		58.36