Share your thoughts, 1 month free Claude Pro on usSee more

Code Repair on CodeFix

85.5Fix Success Rate

GPT-4o

Updated 1mo ago

Evaluation Results

Method	Links
GPT-4o 2026.01		85.5
o3-mini 2026.01		80.6
GPT-4o 2026.01		80
GPT-4o 2026.01		79.7
o3-mini 2026.01		74.5
o3-mini 2026.01		61.7
o3-mini 2026.01		35.6
GPT-4o 2026.01		29.5
Qwen2.5-7B 2026.01		28.4
Qwen2.5-7B 2026.01		28.1
Qwen2.5-7B 2026.01		27.2
Qwen2.5-Coder-7B 2026.01		26.3
Qwen2.5-Coder-7B 2026.01		22.2
DeepSeek-R1-Distill-Qwen-7B 2026.01		16.3
DeepSeek-R1-Distill-Qwen-7B 2026.01		16.3
Qwen2.5-7B 2026.01		14.5
DeepSeek-R1-Distill-Qwen-7B 2026.01		14.2
Qwen2.5-Coder-7B 2026.01		13.6
Qwen2.5-Coder-7B 2026.01		11.8
DeepSeek-R1-Distill-Qwen-7B 2026.01		8.3