Share your thoughts, 1 month free Claude Pro on usSee more

Code Generation on MBPP (Acc, TPF, AUP)

63.6Accuracy

Qwen-2.5-7B-it

Updated 1d ago

Evaluation Results

Method	Links
Qwen-2.5-7B-it 2026.03		63.6	1	63.6	-	-
EAGLE-3 (LLaMA-3.1) 2026.03		60.2	5.69	298.6	-	-
LightningRL-8B-b32 2026.03		58.3	11.1	641.6	-	-
SDAR-8B-b32 2026.03		58	2.44	81.1	-	-
Dream 2026.03		57.2	1	57.2	-	-
d3LLM-Dream 2026.03		55.6	2.96	141.4	-	-
dParallel-Dream 2026.03		55.4	2.24	108	-	-
Fast-dLLM-Dream 2026.03		53.2	1.2	63.6	-	-
Fast-dLLM-v2 2026.03		50.1	2.04	81.9	-	-
LLaDA 2026.03		47.1	1	47.1	-	-
LLaDA 2026.05		41.7	1	41.7	-	-
TAD-Q 2026.05		41.6	3.38	89.3	-	-
d3LLM-LLaDA 2026.03		40.6	4.21	88.4	-	-
d3LLM 2026.05		40.6	4.21	88.4	-	-
TAD-S 2026.05		40.6	3.42	80.3	-	-
dParallel-LLaDA 2026.03		40	2.35	60.5	-	-
dParallel 2026.05		40	2.35	60.5	-	-
Fast-dLLM-LLaDA 2026.03		38.6	2.13	56.6	-	-
Fast-dLLM 2026.05		38.6	2.13	56.6	-	-
D2F-LLaDA 2026.03		38	1.94	50	-	-
D2F 2026.05		38	1.94	53	-	-
SPD-QA 2026.05		21	-	-	-	-
Base model 2026.05		17	-	-	-	-
SSD-QA 2026.05		12	-	-	-	-
ZERO-SHOT 2026.05		-	-	-	36.4	-
PROMPT TUNING 2026.05		-	-	-	37	-
P-TUNING 2026.05		-	-	-	34.27	-
LORA 2026.05		-	-	-	37.2	-
HIRA 2026.05		-	-	-	27	-
NaRA 2026.05		-	-	-	38.6	-
Origin 2026.05		-	-	-	47	52.3
Self-Distillation 2026.05		-	-	-	46.6	53.1
Mask-PPL 2026.05		-	-	-	49	54.7
Hint-decoding 2026.05		-	-	-	50	56.3
DASD 2026.05		-	-	-	50.4	56.7
Origin 2026.05		-	-	-	61.4	70.8
Self-Distillation 2026.05		-	-	-	53.2	69.7
Mask-PPL 2026.05		-	-	-	55.6	71.1
Hint-decoding 2026.05		-	-	-	57.4	71.6
DASD 2026.05		-	-	-	63.2	74.3
Origin 2026.05		-	-	-	37	43
Self-Distillation 2026.05		-	-	-	36.4	44.8
Mask-PPL 2026.05		-	-	-	36.4	45.4
Hint-decoding 2026.05		-	-	-	37	45.9
DASD 2026.05		-	-	-	38	47