Share your thoughts, 1 month free Claude Pro on usSee more

Question Answering on ARC Easy (Accuracy, Drop, TC2b)

94.82Accuracy

Qwen3-32B (+P)

Updated 23h ago

Evaluation Results

Method	Links
Qwen3-32B (+P) 2026.06		94.82	-0.42	99.92
Qwen3-32B (FP16) 2026.06		94.78	-	-
Qwen3-32B (+P + L) 2026.06		94.61	-0.42	99.92
Qwen3-32B (2bit) 2026.06		94.36	-0.42	99.92
Qwen3-8B (FP16) 2026.06		94.32	-	-
Qwen3-32B (+L) 2026.06		94.19	-0.42	99.92
Qwen3-8B (+P) 2026.06		89.31	-9.18	85.77
Qwen3-8B (+P + L) 2026.06		88.34	-9.18	85.77
Qwen3-8B (+L) 2026.06		86.08	-9.18	85.77
Qwen3-8B (2bit) 2026.06		85.14	-9.18	85.77