Share your thoughts, 1 month free Claude Pro on usSee more

Code Completion on MBPP (test)

69.43-Shot Pass Rate

Yi-Coder-9B

Updated 1mo ago

Evaluation Results

Method	Links
Yi-Coder-9B 2024.11		69.4
Qwen2.5-Coder-7B 2024.11		68.8
DS-Coder-V2-Lite-Base (MoE) 2024.11		62.6
CodeQwen1.5-7B 2024.11		61.8
DS-Coder-6.7B-Base 2024.11		60.6
OpenCoder-8B-Base 2024.11		60.6
Qwen2.5-Coder-1.5B 2024.11		59.2
StarCoder2-7B 2024.11		55.2
CodeGemma-7B 2024.11		55
OpenCoder-1.5B-Base 2024.11		51.8
Yi-Coder-1.5B 2024.11		51.6
StarCoder2-3B 2024.11		46.4
DeepSeek-Coder-1.3B-Base 2024.11		46.2
CodeGemma-2B 2024.11		45.4
CodeLlama-7B 2024.11		41.4
Crystal-7B 2024.11		31