| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Program Repair | DeepFix (test) | Accuracy71.7 | 9 | |
| Program Correction | DeepFix (test) | Completely Fixed Programs68.2 | 9 | |
| Code Repair | DeepFix | Pass@182.1 | 5 | |
| Single-step Error Repair | DeepFix synthetic (dev) | Accuracy80.2 | 4 | |
| Single-step Error Localization | DeepFix synthetic (dev) | Accuracy98.9 | 4 | |
| Code Repair | DeepFix (test) | Pass@1- | 0 |