Our new X account is live! Follow @wizwand_team for updates

Code Generation on MultiPL-E (Language Scores)

87.8Python Score

Qwen2.5-Coder-7B-Instruct

Updated 4d ago

Evaluation Results

Method
Qwen2.5-Coder-7B-Instruct 2024.11	87.8	76.5	75.6	80.3	81.8	83.2	78.3	48.7	76.5
Yi-Coder-9B-Chat 2024.11	85.4	76	67.7	76.6	72.3	78.9	72.1	45.6	71.8
CodeQwen1.5-7B-Chat 2024.11	83.5	70.9	72	75.9	76.7	77.6	73.9	41.8	71.6
OpenCoder-8B-Instruct 2024.11	83.5	72.2	61.5	75.9	78	79.5	73.3	44.3	71
Qwen2.5-Coder-14B 2026.01	83.5	46.8	69.6	63.3	69.2	61.5	64.6	39.9	62.3
DS-Coder-V2-Lite-Instruct 2024.11	81.1	76.6	75.8	76.6	80.5	77.6	74.5	43	73.2
Stable-DiffCoder-8B-Base 2026.01	80.5	74.1	69.4	70.3	74.8	73.1	74.4	53.2	71.2
DS-Coder-6.7B-Instruct 2024.11	78.6	68.4	63.4	72.8	67.2	72.7	68.9	36.7	66.1
Seed-Coder-8B-Base 2026.01	77.4	72.8	69.6	53.8	77.4	77.6	63.9	48.1	67.6
OpenCoder-1.5B-Instruct 2024.11	72.5	64.6	50.9	61.4	63.5	62.1	55.3	29.7	57.5
Qwen2.5-Coder-7B 2026.01	72	53.2	62.1	60.8	64.2	60.3	59	38.6	58.8
Qwen2.5-Coder-1.5B-Instruct 2024.11	71.2	55.7	50.9	64.6	61	62.1	59	29.1	56.7
Yi-Coder-1.5B-Chat 2024.11	67.7	51.9	49.1	57.6	57.9	59.6	52.2	19	51.9
OpenCoder-8B-Base 2026.01	66.5	63.9	63.4	54.3	68.6	65.8	61.5	44.3	61
DS-Coder-1.3B-Instruct 2024.11	65.2	51.9	45.3	55.1	59.7	52.2	45.3	12.7	48.4
CodeGemma-7B-It 2024.11	59.8	48.1	46.6	51.9	54.7	54	46.6	10.1	46.5
DeepSeek-Coder-33B-Base 2026.01	56.1	51.9	58.4	51.3	52.8	55.3	44.1	32.3	50.3
Llama-3.1-70B-Base 2026.01	54.9	41.1	41	44.2	57.9	55.3	48.4	29.1	46.5
CodeLlama-70B-Base 2026.01	52.4	44.7	49.7	46.7	52.2	56.5	46.6	31.6	48.2
CodeQwen1.5-7B 2026.01	51.8	42.4	52.2	55.7	52.2	49.7	46.6	36.7	48.4
DeepSeek-Coder-6.7B-Base 2026.01	49.4	43	50.3	50	49.7	48.4	38.5	28.5	44.7
StarCoder2-15B 2026.01	46.3	46.2	47.2	53.2	42.1	43.5	39.1	15.8	41.7
CodeLlama-7B-Instruct 2024.11	45.7	32.2	28.6	32.9	39	43.5	31.7	10.1	33
DeepSeek-Coder-V2-Lite-Base 2026.01	40.9	34.8	45.9	41.7	48.4	44.7	47.2	19.6	40.4
StarCoder2-7B 2026.01	35.4	38	40.4	46.2	34	36	30.4	13.9	34.3