Share your thoughts, 1 month free Claude Pro on usSee more

Audio Reasoning on MMAR

83.7Average Accuracy

Gemini-3.1-Pro

Updated 1d ago

Evaluation Results

Method	Links
Gemini-3.1-Pro 2026.06		83.7	-	-	-	-	-	-	-
Gemini-3-Pro 2026.06		81.73	-	-	-	-	-	-	-
AudioToolAgent 2025.10		77	73.33	63.59	82.99	63.64	83.03	81.71	79.17
Gemini 3 Pro 2025.10		76.4	72.73	61.65	84.35	72.73	81.19	78.05	83.33
OmniJigsaw 2026.04		71	-	-	-	-	-	-	-
AudioJigsaw 2026.04		70.7	-	-	-	-	-	-	-
OmniJigsaw 2026.04		69.5	-	-	-	-	-	-	-
Step-Audio-R1 2026.06		69.15	-	-	-	-	-	-	-
OmniJigsaw 2026.04		69.1	-	-	-	-	-	-	-
Step-Audio-R1.1 2026.06		68.75	-	-	-	-	-	-	-
Qwen3-Omni-30B 2026.04		68.5	-	-	-	-	-	-	-
MOSS-Audio-8B-Thinking 2026.06		66.53	-	-	-	-	-	-	-
Qwen3-Omni 2026.04		66.4	-	-	-	-	-	-	-
Qwen3-Omni-30B-A3B-Instruct 2026.06		66.4	-	-	-	-	-	-	-
AudioToolAgent-Open 2025.10		65.9	61.21	57.28	69.05	54.55	69.27	78.05	66.67
Gemini 2.0 Flash 2025.10		65.6	61.21	50.97	72.11	81.82	72.48	65.85	70.83
MOSS-Audio-8B-Instruct 2026.06		64.42	-	-	-	-	-	-	-
MOSS-Audio-4B-Thinking 2026.06		63.91	-	-	-	-	-	-	-
GPT-4o Audio 2025.10		63.5	53.94	50.97	70.41	63.64	72.48	62.2	75
Omni-R1 2025.10		63.4	67.3	51.5	64.3	45.5	70.2	64.6	70.8
MOSS-Audio-4B-Instruct 2026.06		62.54	-	-	-	-	-	-	-
HumanOmniV2 2026.04		61.8	-	-	-	-	-	-	-
MiMo-Audio-7B 2026.06		61.7	-	-	-	-	-	-	-
Kimi-Audio 2026.06		60.82	-	-	-	-	-	-	-
AF3 (think) 2026.04		60.1	-	-	-	-	-	-	-
GPT4o-Audio 2026.06		59.78	-	-	-	-	-	-	-
Omni-R1 2026.04		59.7	-	-	-	-	-	-	-
AVRT 2026.04		59.1	-	-	-	-	-	-	-
Audio Flamingo 3 2026.06		57.96	-	-	-	-	-	-	-
AVRT 2026.04		57.3	-	-	-	-	-	-	-
Qwen2.5-Omni 2025.10		56.7	58.79	40.78	59.86	54.55	61.93	67.07	58.33
Qwen2.5-Omni 2026.06		56.7	-	-	-	-	-	-	-
Qwen2.5 Omni 2026.04		56.5	-	-	-	-	-	-	-
MiniCPM-o-4.5 2026.06		55.75	-	-	-	-	-	-	-
Qwen2.5 Omni 2026.04		53.7	-	-	-	-	-	-	-
v-SALMONN-o1 2026.04		51.2	-	-	-	-	-	-	-
Audio Flamingo Next 2026.06		51.01	-	-	-	-	-	-	-
Audio Reasoner 2025.10		36.8	43.64	33.5	32.99	45.45	42.66	31.71	25