Share your thoughts, 1 month free Claude Pro on usSee more

Code Editing on EditBench Core set

66.67Pass@1

Claude Sonnet 4

Updated 1mo ago

Evaluation Results

Method	Links
Claude Sonnet 4 2026.03		66.67
GPT o4-mini 2026.03		57.41
SEMREP QwQ-32B 2026.03		57.41
Qwen3-Coder 2026.03		55.56
GLM-4.6 2026.03		55.56
Gemini 2.5 Pro 2026.03		54.63
Finetuned QwQ-32B 2026.03		53.7
Qwen2.5-72B-Instruct 2026.03		53.7
QwQ-32B 2026.03		50.93
SEMREP Qwen2.5-Coder-7B 2026.03		32.41
gemma-3-12b-it 2026.03		23.15
Finetuned Qwen2.5-Coder-7B 2026.03		23.15
Qwen2.5-Coder-7B 2026.03		18.52