Audio Question Answering

Benchmarks

Dataset Name	SOTA Method	Metric
MUSIC-AVQA 1.0 (test)	QA-TIGER	Counting Accuracy84.86	43	1mo ago
MMAR	Gemini-2.5-Pro	Average Score70.03	35	1mo ago
MMAU		Score70	18	1mo ago
MUSIC-AVQA (test)	InternVideo2_S2	Accuracy (Avg)80.51	17	1mo ago
ClothoAQA (test)	VideoLLaMA2.1-AV	Accuracy71.02	14	1mo ago
OpenBookQA	Qwen3-Omni-Flash-Instruct	Score91.4	12	22d ago
MMSU	Ming-Flash-Omni	Score72.09	12	22d ago
SD-QA	Qwen3-Omni-Flash-Instruct	Score76.8	12	22d ago
CommonEval	Qwen3-Omni-Flash-Instruct	Score91	12	22d ago
AlpacaEval	Ming-Flash-Omni	AlpacaEval AQA Score95.58	12	22d ago
WenetSpeech-QA	GLM-4-Voice	Audio-QA Score48.47	12	23d ago
Tripoli-QA	GLM-4-Voice	Audio QA Score44.99	12	23d ago
Listen, Quizzing (LQ.)	GLM-4-Voice	Audio-QA Score62.67	12	23d ago
AudioSet En	GLM-4-Voice	Audio QA Score44.87	12	23d ago
AudioCaps-QA (test)	M3KG-RAG	Model-as-Judge Score60.77	12	1mo ago
RACE Audio	Uni-MoE w/ MoE-Task4 (4E)	Accuracy (Sub-task 1)64.21	10	1mo ago
SH-Bench (test)	Step-Audio-2-mini + BPFT	Accuracy (Main Speaker, General)0.974	10	1mo ago
MMAU-style Complex QA	Speech-Hands	Accuracy85.7	9	1mo ago
Multi-sound-object soundscapes	Qwen2.5-Omni	Accuracy72.1	9	1mo ago
Bio-acoustic QA	Speech-Hands	Accuracy81.25	9	1mo ago
speech-web-questions (S-Web)	AudioKV	Accuracy55.5	8	9d ago
speech-chatbot-alpaca-eval (S-Alpaca)	AudioKV	Accuracy66.7	8	9d ago
Clotho AQA		Score85.6	7	1mo ago
TELEVAL AQA-en (dev)	Our Model	TELEVAL Score57.69	6	1mo ago
TELEVAL AQA-zh (dev)	Qwen3-omni	TELEVAL Score49.95	6	1mo ago

Showing 25 of 34 rows