Share your thoughts, 1 month free Claude Pro on usSee more

Accuracy on GPQA Diamond (Knowledge)

81.3Accuracy (GPQA Knowledge)

Qwen3.5-9B

Updated 18d ago

Evaluation Results

Method	Links
Qwen3.5-9B 2026.05		81.3
Kimi-K2.5 2026.06		80.52
DeepSeek-V3.2 2026.06		77.11
GPT-5.4 2026.06		76.89
Qwen3.5-4B 2026.05		76.8
Qwen3.5-Omni Flash 35B-A3B 2026.07		76.4
Qwen3.5-4B 2026.05		76.2
Ling-2.6-1T 2026.06		76.17
Audex 30B-A3B 2026.07		74.9
Qwen3-Omni 30B-A3B Thinking 2026.07		73.1
ZAYA1-8B 2026.05		71
GLM-5 2026.06		70.2
Qwen3-4B-Thinking-2507 2026.05		66.1
Step-Audio R1.1 33B 2026.07		60.7
Qwen3-8B 2026.03		60.1
SSA-LLM-8B 2026.03		60.1
Mellum 2 (RL) 2026.05		57.6
Gemma-4-E4B-it 2026.05		57.4
Qwen3-14B + NGM 2026.05		52.02
Qwen3-8B 2026.03		51.52
Qwen3-8B + NGM 2026.05		51.52
Qwen3-8B 2026.05		51.01
Qwen3-14B 2026.05		48.99
Audex 2B 2026.07		47.2
Qwen3-4B + NGM 2026.05		46.46
Qwen2.5-72B 2026.05		46
Ministral-3-14B 2026.05		46
SSA-LLM-8B 2026.03		44.44
Qwen2.5-32B 2026.05		43.9
Qwen3-4B 2026.05		43.43
Qwen2.5-14B 2026.05		41.9
Mellum 2 (SFT) 2026.05		39.9
FORGE-7B-NP-MATH 2026.05		38.9
Voxtral Small-24B 2507 2026.07		37.9
FORGE-7B-NP 2026.05		37.4
InternLM3-8B 2026.05		36.9
FORGE-7B-MATH 2026.05		33.8
Qwen2.5-7B 2026.05		33.3
Qwen3-1.7B 2026.05		32.83
Qwen3-1.7B + NGM 2026.05		31.31
Qwen2.5-3B 2026.05		30.3
OLMo-3-7B 2026.05		29.3
Qwen3-0.6B + NGM 2026.05		29.29
Qwen3-0.6B 2026.05		26.77
LLama3.1-8b 2026.05		22.7
Original (T2T) 2026.04		21.72
T2M 2026.04		21.72
Qwen2.5-7B-SFT 2026.05		18.7
MiMo-Audio 7B 2026.07		13.8