Share your thoughts, 1 month free Claude Pro on usSee more

Code on MBPP (Pass@1)

77.9Pass@1

PrivCode

Updated 11d ago

Evaluation Results

Method	Links
PrivCode 2025.12		77.9
NonDPFT 2025.12		77.2
NonDPFT 2025.12		74.3
NonDPFT 2025.12		73.8
PrivCode 2025.12		72.5
SDAR-8B-Chat 2026.04		71.6
DP-Adapter 2025.12		69.6
PrivCode 2025.12		69
JFT 2025.12		68.1
JFT 2025.12		67.6
Qwen3 2025.12		67.5
Youtu-LLM 2025.12		66.6
JFT 2025.12		66.4
DPFT 2025.12		66.4
PrivCode 2025.12		66.1
DPFT 2025.12		65.8
NonDPFT 2025.12		64.8
LLaDA2.0-mini 2026.04		64.8
DP-Adapter 2025.12		62.9
LLaDA2.1-mini 2026.04		62.6
DP-Adapter 2025.12		61.4
Llama3.1-Instruct 2026.02		57.8
Dream-7B-Instruct 2026.04		56.4
DPFT 2025.12		56.3
Qwen3 2025.12		55.6
SDAR-30B-A3B 2026.04		52
JFT 2025.12		51.7
SmolLM3 2025.12		51
ProSeCo Sampling 2026.02		50.2
Llama3.1 2025.12		49.4
DP-Adapter 2025.12		48.8
Engram-27B 2026.01		48.2
MoE-27B 2026.01		46.6
Engram-40B 2026.01		46.2
Gemma3 2025.12		45.8
DPFT 2025.12		45
ProSeCo SFT 2026.02		44
Vanilla SFT 2026.02		43.2
Vanilla SFT + ReMDM 2026.02		42.4
LLaDA-Base 2026.02		40.4
LLaDA-8B-Instruct 2026.04		38.8
Dense-4B 2026.01		35.4
LLaDA-Instruct + ReMDM 2026.02		35.2
LLaDA-Instruct + PRISM 2026.02		32.3
LLaDA-Instruct 2026.02		29.4
LLaDA1.5 2026.02		27.2
CDLM 2025.12		17.5
MDLM 2025.12		11.4
Base 2025.12		11.4