Software Engineering Issue Resolution on SWE-Bench Lite
73.5Resolution Rate
AIR
Updated 1mo ago
Evaluation Results
| Method | Links | |
|---|---|---|
2025.12 | 73.5 | |
2025.12 | 56.67 | |
2025.02 | 41.7 | |
2025.02 | 40.7 | |
2025.12 | 37.3 | |
2025.12 | 33.6 | |
2025.12 | 27.7 | |
2025.02 | 24 | |
2025.02 | 23.3 | |
2025.02 | 22 | |
2025.02 | 20.7 | |
2025.02 | 15.3 | |
2025.02 | 14 | |
2025.02 | 12.7 | |
2025.02 | 12 | |
2025.02 | 10 |