Share your thoughts, 1 month free Claude Pro on usSee more

Instructional code editing on CanItEdit Lazy Instructions

43.89Pass@1

DeepSeekCoder-Instruct-33B

Updated 1mo ago

Evaluation Results

Method	Links
DeepSeekCoder-Instruct-33B 2024.02		43.89
StarCoder2-15B 2024.02		38.45
DeepSeekCoder-Instruct-6.7B 2024.02		33.61
CodeLlama-Instruct-7B 2024.02		27.04
CodeLlama-Instruct-34B 2024.02		26.76
StarCoderBase-15B 2024.02		26.38
StarCoderBase-7B 2024.02		25.83
OctoCoder-15B 2024.02		25.69
CodeLlama-Instruct-13B 2024.02		20.19
StarCoder2-7B 2024.02		18.55
DeepSeekCoder-Instruct-1.3B 2024.02		18.33
StarCoder2-3B 2024.02		15.91
StarCoderBase-3B 2024.02		12.78