Software Engineering on SWE-Bench-Verified (50 cases)
72Accuracy
SWE-agent + Claude 3.7 Sonnet w/ Review Heavy
Updated 1mo ago
Evaluation Results
| Method | Links | |
|---|---|---|
| 72 | ||
| 70 | ||
2025.05 | 68 | |
| 66 | ||
2025.05 | 66 | |
2025.05 | 62 | |
| 54 | ||
| 52 | ||
2025.05 | 48 | |
2025.05 | 46 | |
2025.05 | 12 | |
| 10 |
SWE-agent + Claude 3.7 Sonnet w/ Review Heavy
| Method | Links | |
|---|---|---|
| 72 | ||
| 70 | ||
2025.05 | 68 | |
| 66 | ||
2025.05 | 66 | |
2025.05 | 62 | |
| 54 | ||
| 52 | ||
2025.05 | 48 | |
2025.05 | 46 | |
2025.05 | 12 | |
| 10 |