Share your thoughts, 1 month free Claude Pro on usSee more

Code Generation on HumanEval (Accuracy, Avg.)

81.71Accuracy

Qwen3 8B

Updated 17d ago

Evaluation Results

Method	Links
Qwen3 8B 2026.07		81.71	-
Nemotron-Labs-Diffusion-8B 2026.07		81.71	-
Nemotron-Labs-Diffusion-8B 2026.07		80.49	-
SDAR-8B Chat 2026.07		79.27	-
Nemotron-Labs-Diffusion-8B 2026.07		79.27	-
SDAR-8B Chat 2026.07		78.7	-
Nemotron-Labs-Diffusion-8B 2026.07		78.66	-
Qwen2.5 7B 2026.07		77.44	-
Ministral3-8B Instruct-2512 2026.07		71.04	-
Dream-7B Instruct 2026.07		55.5	-
LLaDA-8B Instruct 2026.07		49.4	-
Skew F(R)KL 2026.05		42.07	47.29
α-β divergence 2026.05		41.46	47.09
HybKD 2026.05		41.46	47.89
Reverse KL 2026.05		39.02	46.34
Forward KL 2026.05		38.41	46.76
Hard KD 2026.05		35.37	44.66