Our new X account is live! Follow @wizwand_team for updates

Code Infilling on HumanEval multi-line code infilling

38.6Pass Rate

CM infilling

Updated 4d ago

Evaluation Results

Method	Links
CM infilling 2022.04		38.6	20.6	-	-	-
CM infilling 2022.04		38.6	20.6	-	-	-
code-davinci-001 2022.04		37.8	19.8	-	-	-
code-davinci-001 2022.04		37.8	19.8	-	-	-
code-cushman-001 2022.04		30.8	17.4	-	-	-
code-cushman-001 2022.04		30.8	17.4	-	-	-
L-R reranking 2022.04		28.2	17.6	-	-	-
L-R reranking 2022.04		28.2	17.6	-	-	-
L-R single 2022.04		24.9	15.8	-	-	-
L-R single 2022.04		24.9	15.8	-	-	-
PLBART 2022.04		13.1	-	-	-	-
PLBART 2022.04		13.1	-	-	-	-
InCoder 2023.08		-	-	38.6	-	-
OpenAI FIM90 2023.08		-	-	44.1	-	-
code-davinci-002 2023.08		-	-	69.9	-	-
Code Llama 2023.08		-	-	49.7	51.2	-
Code Llama 2023.08		-	-	48.2	50.8	-
Code Llama 2023.08		-	-	53.7	56.7	-
Code Llama 2023.08		-	-	51	56.1	-
Deepseek-Coder-6.7B 2026.02		-	-	-	-	45.7
Seed-Coder-8B 2026.02		-	-	-	-	59.3
Qwen2.5-Coder-7B 2026.02		-	-	-	-	58.7
LLaDA-8B 2026.02		-	-	-	-	21.1
Dream-7B 2026.02		-	-	-	-	21.9
DREAMON 2026.02		-	-	-	-	53.3
DiffuCoder-7B 2026.02		-	-	-	-	45
DREAMON 2026.02		-	-	-	-	63.1
DreamCoder-7B 2026.02		-	-	-	-	43.2
DREAMON 2026.02		-	-	-	-	63.8