Share your thoughts, 1 month free Claude Pro on usSee more

Music Understanding on MusicBench Global

96.8PG Score

GaMMA-8B

Updated 1mo ago

Evaluation Results

Method	Links
GaMMA-8B 2026.05		96.8	93	84	87.2	89	88.6	90	88.6	83.3	99.5	80	87.5	61	50.6	84	74	78	82.6
Gemini-3.0 Pro 2026.05		96	96	87.8	95.7	78.1	78.6	86	80	93.3	98.5	50	58	52.5	56.4	78.5	81	80	80.4
GaMMA-14B 2026.05		95.5	93	83.4	89.4	90.4	87.1	90	88.6	76.7	97.5	80	89.5	48.5	51.5	85	93	79	81.3
Gemini-2.0-Pro 2026.05		94.3	91	75.8	76.6	67.1	70	74	58.6	73.3	83	80	28.5	53.5	43.2	74.5	69.5	79	70.3
Qwen2.5-Omni 2026.05		94	95	83	89	96	90	95	77	77	98	90	65	51	44	74	71	79	78
Gemini-2.5 Pro 2026.05		92.2	94.5	87.4	93.8	81.7	85.7	90.3	84.6	89.7	99	70	41.5	49.3	53.9	77.9	76.2	84.5	76.7
Kimi-Audio 2026.05		88.8	83	78.2	70.2	78.1	70	86	72.9	80	91.5	80	26	40	42.7	48	61.5	80	67.6
Qwen2Audio 2026.05		74.3	76	75.2	68.1	60.3	42.9	62	42.9	80	77	80	20.5	31	29.5	52.5	37.5	40	56
Audio-Flamingo3 2026.05		71	79.6	83.3	77.8	61.1	60.6	82.2	53.2	58.6	96.9	50	80	60.3	42	72.9	66.7	72.1	72.8
QwenAudio 2026.05		67.5	45	70.6	51.1	56.2	30	45	54.3	26.7	71	60	29.5	35	29.1	60	38.5	35	52
Mu-LLaMA 2026.05		27.3	15	16.4	23.4	32.9	28.6	43	27.1	16.7	21	50	21	32	22.8	27	14	4	22.7
SALMONN 2026.05		24.5	18	29	29.8	28.8	31.4	23	27.1	33.3	22.5	30	36	27	24.9	26	21	36	26.8
M2UGen 2026.05		20.5	24	26.4	31.9	16.4	25.7	26	38.6	46.7	25	30	21.5	29.5	24.9	25	33	32	26