Code Generation on MBPP+ (MB+)

54.2MB+ Score

75% CodeEnhance-gemma-4b + 15% CodeQA + 10% Raw

Updated 19d ago

Evaluation Results

Method	Links
75% CodeEnhance-gemma-4b + 15% CodeQA + 10% Raw 2026.06		54.2
85% CodeEnhance-gemma-4b + 10% CodeQA + 5% Raw 2026.06		54
80% CodeEnhance-gemma-4b + 15% CodeQA + 5% Raw 2026.06		54
90% (CodeEnhance-gemma-4b+CodeQA) + 10% Raw 2026.06		53.7
95% (CodeEnhance-gemma-4b+CodeQA) + 5% Raw 2026.06		53.4
CodeEnhance-gemma-4b 2026.06		52.1
95% SwallowCode + 5% Raw 2026.06		48.1
Nemotron-RW 2026.06		46.6
95% Nemotron-RW + 5% Raw 2026.06		46.6
CodeEnhance-gemma-1b 2026.06		46.3
50% CodeEnhance + 50% Nemotron-RW 2026.06		39.9
90% CodeEnhance+CodeQA + 10% Raw 2026.06		39.7
Olmo3 Base 2026.07		37.6
SwallowCode 2026.06		36.8
LMK token tuning 2026.07		33.8
HiLS-Attn RoPE-Q-Cal 2026.07		33.3
HiLS-Attn HoPE-Q-Cal 2026.07		32.6
Olmo3 512swa 2026.07		32.3
HiLS-Attn NoPE-Q-Cal 2026.07		31.1
95% CodeEnhance+CodeQA + 5% Raw 2026.06		28
CodeEnhance+Nemotron-RW+SwallowCode 2026.06		13.8
CodeEnhance+CodeQA 2026.06		13
CodeEnhance 2026.06		5