Our new X account is live! Follow @wizwand_team for updates

Code Generation on MBPP+ (pass@1)

83.6Pass@1

GLM 4.6

Updated 4d ago

Evaluation Results

Method
GLM 4.6 2025.12	83.6	-
DeepSeek V3.2 2025.12	79.9	-
LongCat-Flash Chat 2025.12	79.6	-
LongCat-Flash Exp-Chat 2025.12	79.1	-
UCoder-32B 2025.12	75.7	-
DS-Coder-V2-Instruct 2025.12	75.1	-
Qwen2.5-Coder-32B-Instruct 2025.12	75.1	-
Claude-3.5-Sonnet-20241022 2025.12	74.6	-
UCoder-14B 2025.12	74.3	-
Kimi-K2 Base 2026.01	73.8	-
Qwen2.5-Coder-14B-Instruct 2025.12	72.8	-
GPT-4o-2024-08-06 2025.12	72.5	-
DeepSeek-V3.1 Base 2026.01	72.2	-
UCoder-7B 2025.12	72.2	-
Qwen2.5-Coder-7B-Instruct 2025.12	71.7	-
MiMo-V2-Flash Base 2026.01	71.4	-
GPT-4-Turbo 2024.05	70.7	-
DS-Coder-V2-Lite-Instruct 2025.12	70.4	-
DS-Coder-33B-Instruct 2025.12	70.1	-
DeepSeek-V3.2 Exp Base 2026.01	69.8	-
GPT-3.5-Turbo 2024.05	69.4	-
OpenCoder-8B-Instruct 2025.12	69	-
Qwen2.5-Coder-32B 2025.12	68.2	-
SecCoderX 2026.02	67.49	83.86
Qwen2.5-Coder-14B 2025.12	66.7	-
SWaRL 2026.01	66.2	83.03
DS-Coder-6.7B-Instruct 2025.12	65.6	-
EXP-edit 2026.01	65.38	82.9
Base+SFT 2026.01	65.26	84.18
Starcoder2-15B-Instruct-v0.1 2025.12	65.1	-
Base 2026.02	64.95	84.66
PrivCode 2025.12	64.8	-
ProSec 2026.02	64.1	76.19
Qwen2.5-Coder-7B 2025.12	62.9	-
NonDPFT 2025.12	61.9	-
NonDPFT 2025.12	61.6	-
SecCoderX 2026.02	61.53	83.86
NonDPFT 2025.12	61.4	-
AlchemistCoder-DS 2024.05	60.2	-
PrivCode 2025.12	60.1	-
JFT 2025.12	60	-
DeepSeek-Coder-Instruct 2024.05	59.7	-
PrivCode 2025.12	59	-
LEDEX RL 2024.05	57.89	73.48
Base 2026.02	57.75	82.01
LEDEX RL 2024.05	56.62	72.04
MagicoderS-DS 2024.05	56.1	-
DPFT 2025.12	55.8	-
ProSec 2026.02	55.74	67.2
Magicoder-DS 2024.05	55.6	-
DeepSeek-Coder-Instruct 2024.05	55.6	-
LEDEX SFT 2024.05	55.58	73.41
CodeLlama-Instruct 2024.05	55.1	-
AlchemistCoder-CL 2024.05	55.1	-
JFT 2025.12	55	-
DP-Adapter 2025.12	54.9	-
NonDPFT 2025.12	54.8	-
LEDEX SFT 2024.05	54.59	72.15
DP-Adapter 2025.12	54.5	-
LEDEX RL 2024.05	54.29	71.93
SafeCoder 2026.02	54.18	76.46
LEDEX RL 2024.05	54.13	71.71
LEDEX SFT 2024.05	53.83	72.19
PrivCode 2025.12	53.7	-
DeepSeek-Coder-Base 2024.05	53.6	-
LEDEX SFT 2024.05	53.53	71.55
LEDEX RL 2024.05	52.9	71.8
JFT 2025.12	52.9	-
CodeLlama-Python 2024.05	52.4	-
LEDEX RL 2024.05	52.11	71.88
WizardCoder-CL 2024.05	51.9	-
LEDEX SFT 2024.05	51.64	71.04
DPFT 2025.12	51.6	-
LEDEX SFT 2024.05	51.55	70.94
CodeLlama-13B-Instruct 2025.12	51.1	-
CodeLlama-34B-Instruct 2025.12	50.5	-
CodeLlama-Python 2024.05	50.4	-
AlchemistCoder-L 2024.05	49.6	-
SafeCoder 2026.02	49.55	74.07
MagicoderS-CL 2024.05	49.1	-
DPFT 2025.12	48.9	-
SafeCoder 2026.02	47.41	70.37
DP-Adapter 2025.12	46.6	-
Prompt 2024.05	46.22	70.14
Magicoder-CL 2024.05	46.1	-
Prompt 2024.05	45.77	70.48
CodeLlama-Python 2024.05	45.6	-
LEDEX RL 2024.05	45.49	62.81
LEDEX RL 2024.05	44.94	63.92
WizardCoder-SC 2024.05	44.9	-
DP-Adapter 2025.12	44.5	-
LEDEX SFT 2024.05	43.67	62.63
JFT 2025.12	43.6	-
StarCoder 2024.05	43.4	-
LEDEX SFT 2024.05	43.28	62.48
Prompt 2024.05	42.97	66.89
LEDEX SFT 2024.05	42.97	62.69
DPFT 2025.12	42.9	-
SWEET 2026.01	42.79	63.29
Prompt 2024.05	42.46	67.41

Showing 100 of 122 rows