| Dataset Name | SOTA Method | Metric | Trend | ||
|---|---|---|---|---|---|
| QuixBugs-Java 40 bugs | Pass@1 Rate100 | 16 | 22d ago | ||
| HumanEval Java (164 tasks) | BOOSTAPR (+ Rline) | Pass@1 Rate84.5 | 16 | 22d ago | |
| Defects4J 835 bugs v2.0 | BOOSTAPR (+ Rline) | Pass@124.8 | 16 | 22d ago | |
| SWE-bench Verified 500 instances | SWE-RL | Pass@1 Rate41 | 16 | 22d ago | |
| Defects4J 2.0 | MGDebugger | V2.0 Count64 | 7 | 3mo ago | |
| Defects4J v1.2 | Chart Success Count15 | 7 | 3mo ago | ||
| Real-world C programs All errors (test) | DS-SampleFix + BS | Compilation Success Rate45.2 | 6 | 3mo ago | |
| Real-world C programs Typographic errors (test) | DS-SampleFix + BS | Compilation Success Rate27.8 | 6 | 3mo ago | |
| Real-world C programs (Missing variable declarations) (test) | Compilation Success Rate20.3 | 5 | 3mo ago | ||
| Synthetic C Programs (test) | DS-SampleFix | Typo Success Rate95.6 | 4 | 3mo ago | |
| 10 projects (100 total issues) | AIR | Total Solved Issues70 | 3 | 3mo ago |
