SWE tasks
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Software Engineering | SWE tasks Configuration Integration n = 20 (test) | F1 Score59.27 | 4 | |
| Software Engineering | SWE tasks Diagnosis Search n = 30 (test) | F1 Score53.68 | 4 | |
| Software Engineering | SWE tasks Performance Data n = 10 (test) | F1 Score49.64 | 4 | |
| Software Engineering | SWE tasks Refactor API Migration n = 39 (test) | F1 Score56.12 | 4 | |
| Software Engineering | SWE tasks Robustness Fix n = 55 (test) | F1 Score57.9 | 4 | |
| Software Engineering | SWE tasks Feature Patch n = 125 (test) | F1 Score55.72 | 4 |
Showing 6 of 6 rows