Share your thoughts, 1 month free Claude Pro on usSee more

Code Completion on MBPP Sanitized

79.9MBPP Pass Rate

OpenCoder-8B-Base

Updated 1mo ago

Evaluation Results

Method	Links
OpenCoder-8B-Base 2024.11		79.9	70.4
Qwen2.5-Coder-7B 2024.11		76.9	62.9
CodeQwen1.5-7B 2024.11		72.2	60.2
DS-Coder-V2-Lite-Base (MoE) 2024.11		71.9	59.4
OpenCoder-1.5B-Base 2024.11		70.6	58.7
DS-Coder-6.7B-Base 2024.11		70.2	56.6
Qwen2.5-Coder-1.5B 2024.11		69.2	58.6
StarCoder2-15B 2024.11		66.2	53.1
StarCoder2-3B 2024.11		60.2	49.1
DeepSeek-Coder-1.3B-Base 2024.11		55.6	46.9
CodeLlama-7B 2024.11		55.3	46.8
StarCoder2-7B 2024.11		54.4	45.6
CodeGemma-2B 2024.11		51.1	43.1
CodeGemma-7B 2024.11		50.5	40.7
Yi-Coder-9B 2024.11		48.4	40.7
Crystal-7B 2024.11		38.6	31.7
Yi-Coder-1.5B 2024.11		27	22.2