Share your thoughts, 1 month free Claude Pro on usSee more

Accuracy on GPQA Diamond (Knowledge)

81.3Accuracy (GPQA Knowledge)

Qwen3.5-9B

Updated 2d ago

Evaluation Results

Method	Links
Qwen3.5-9B 2026.05		81.3
Qwen3.5-4B 2026.05		76.8
Qwen3.5-4B 2026.05		76.2
ZAYA1-8B 2026.05		71
Qwen3-4B-Thinking-2507 2026.05		66.1
Qwen3-8B 2026.03		60.1
SSA-LLM-8B 2026.03		60.1
Mellum 2 (RL) 2026.05		57.6
Gemma-4-E4B-it 2026.05		57.4
Qwen3-14B + NGM 2026.05		52.02
Qwen3-8B 2026.03		51.52
Qwen3-8B + NGM 2026.05		51.52
Qwen3-8B 2026.05		51.01
Qwen3-14B 2026.05		48.99
Qwen3-4B + NGM 2026.05		46.46
Qwen2.5-72B 2026.05		46
Ministral-3-14B 2026.05		46
SSA-LLM-8B 2026.03		44.44
Qwen2.5-32B 2026.05		43.9
Qwen3-4B 2026.05		43.43
Qwen2.5-14B 2026.05		41.9
Mellum 2 (SFT) 2026.05		39.9
FORGE-7B-NP-MATH 2026.05		38.9
FORGE-7B-NP 2026.05		37.4
InternLM3-8B 2026.05		36.9
FORGE-7B-MATH 2026.05		33.8
Qwen2.5-7B 2026.05		33.3
Qwen3-1.7B 2026.05		32.83
Qwen3-1.7B + NGM 2026.05		31.31
Qwen2.5-3B 2026.05		30.3
OLMo-3-7B 2026.05		29.3
Qwen3-0.6B + NGM 2026.05		29.29
Qwen3-0.6B 2026.05		26.77
LLama3.1-8b 2026.05		22.7
Original (T2T) 2026.04		21.72
T2M 2026.04		21.72
Qwen2.5-7B-SFT 2026.05		18.7