Software engineering agent task completion on SWE-Bench Verified
78.2Accuracy
LLM-as-a-Verifier
Updated 19d ago
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
2026.07 | 78.2 | - | - | |
2026.07 | 76.8 | - | - | |
2026.07 | 75.8 | - | - | |
2026.07 | 75.8 | - | - | |
2026.07 | - | 76.1 | 84.4 |
LLM-as-a-Verifier
| Method | Links | |||
|---|---|---|---|---|
2026.07 | 78.2 | - | - | |
2026.07 | 76.8 | - | - | |
2026.07 | 75.8 | - | - | |
2026.07 | 75.8 | - | - | |
2026.07 | - | 76.1 | 84.4 |