Software Engineering on SWE-Bench (val)
28.8Acc
Claude 3.7 Sonnet
Updated 4d ago
Evaluation Results
| Method | Links | ||
|---|---|---|---|
2026.02 | 28.8 | 77.5 | |
2026.02 | 8.8 | 30 | |
2026.02 | 2.5 | 20 | |
2026.02 | 1.3 | 2.5 | |
2026.02 | 0 | 15 | |
2026.02 | 0 | 0 | |
2026.02 | 0 | 2.5 |
Claude 3.7 Sonnet
| Method | Links | ||
|---|---|---|---|
2026.02 | 28.8 | 77.5 | |
2026.02 | 8.8 | 30 | |
2026.02 | 2.5 | 20 | |
2026.02 | 1.3 | 2.5 | |
2026.02 | 0 | 15 | |
2026.02 | 0 | 0 | |
2026.02 | 0 | 2.5 |