Share your thoughts, 1 month free Claude Pro on usSee more

Automated Program Repair on QuixBugs-Java 40 bugs

100Pass@1 Rate

ChatRepair

Updated 22d ago

Evaluation Results

Method	Links
ChatRepair 2026.05		100
+ Stage III (PPO, Rseq only) 2026.05		95
BOOSTAPR (+ Rline) 2026.05		95
Lingma SWE-GPT 2026.05		92.5
SWE-Fixer 2026.05		92.5
+ Stage I (SFT) 2026.05		92.5
SWE-Gym 2026.05		90
SWE-RL 2026.05		90
Qwen2.5-Coder-32B (base) 2026.05		90
Agentless 2026.05		87.5
SWE-agent 2026.05		85
AutoCodeRover 2026.05		82.5
RLEF 2026.05		80
RepairLLaMA 2026.05		75
CodeRL 2026.05		67.5
KNOD 2026.05		62.5