Share your thoughts, 1 month free Claude Pro on usSee more

Code Generation on MBPP (Accuracy, Avg.)

63.49Accuracy

Forward KL

Updated 1d ago

Evaluation Results

Method	Links
Forward KL 2026.05		63.49	46.76
HybKD 2026.05		63.12	47.89
Reverse KL 2026.05		62.17	46.34
Skew F(R)KL 2026.05		60.85	47.29
Hard KD 2026.05		60.32	44.66
α-β divergence 2026.05		60.05	47.09
ESPO 2026.05		43.6	-
GDSD 2026.05		43.6	-
GDSD w/ TLC 2026.05		43.6	-
ESPO 2026.05		43.2	-
GDSD w/ TLC 2026.05		43.2	-
GDSD w/ TLC 2026.05		43	-
LLaDA-8B 2026.05		42	-
GDSD 2026.05		41.8	-
ESPO 2026.05		41.2	-
SPG 2026.05		40.8	-
GDSD 2026.05		40.6	-
SPG 2026.05		40.4	-
SPG 2026.05		40.4	-
LLaDA-8B 2026.05		38.1	-
diffu-GRPO (d1) 2026.05		38	-
wd1 2026.05		38	-
wd1 2026.05		37.2	-
diffu-GRPO (d1) 2026.05		36.6	-
LLaDA-8B 2026.05		36.2	-
diffu-GRPO (d1) 2026.05		34.8	-
wd1 2026.05		34.4	-
LLaDA-8B 2026.05		-	38.8
diffu-GRPO (d1) 2026.05		-	36.5
wd1 2026.05		-	36.5
SPG 2026.05		-	40.5
ESPO 2026.05		-	42.7
GDSD 2026.05		-	42
GDSD w/ TLC 2026.05		-	43.3
Base Model 2026.06		-	19.8
Frozen Router 2026.06		-	17.8
Conventional 2026.06		-	23.2
DenseMixer 2026.06		-	24.4
ProbMoE 2026.06		-	22.8
Base Model 2026.06		-	38.84
Frozen Router 2026.06		-	35.2
Conventional 2026.06		-	32.8
DefaultMoE 2026.06		-	33.2
SparseMixer 2026.06		-	0
ReMoE 2026.06		-	33
DenseMixer 2026.06		-	34
ProbMoE 2026.06		-	35