Share your thoughts, 1 month free Claude Pro on usSee more

Code Generation on MBPP (MBPP, MBPP+)

83.6MBPP

Stable-DiffCoder-8B-Base

Updated 1mo ago

Evaluation Results

Method	Links
Stable-DiffCoder-8B-Base 2026.01		83.6	67.7
Qwen2.5-Coder-14B 2026.01		83.6	69.8
Seed-Coder-8B-Base 2026.01		82	69
Llama-3.1-70B-Base 2026.01		81.4	67.2
OpenCoder-8B-Base 2026.01		79.9	70.4
Qwen2.5-Coder-7B 2026.01		79.4	68.3
Dream-Coder-7B-Base 2026.01		75.9	61.6
DiffuCoder-7B-Base 2026.01		74.2	60.9
DeepSeek-Coder-33B-Base 2026.01		74.2	60.7
CodeQwen1.5-7B 2026.01		72.2	60.2
DeepSeek-Coder-V2-Lite-Base 2026.01		71.9	59.4
CodeLlama-70B-Base 2026.01		71	65.6
DeepSeek-Coder-6.7B-Base 2026.01		70.2	56.6
Dream-7B-Base 2026.01		68.7	57.4
WeDLM-8B-Base 2026.01		67	-
StarCoder2-15B 2026.01		66.2	53.1
StarCoder2-7B 2026.01		54.4	45.6
LLaDA-MoE-7B-A1B-Base 2026.01		52.4	-
LLaDA-8B-Base 2026.01		50.1	42.1