Failure prediction on SWE-agent (Transfer held-out)
0.69ROC-AUC
Src-aware
Updated 1mo ago
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
2026.06 | 0.69 | - | - | |
| 0.69 | 0.623 | 0.001 | ||
| 0.646 | 0.573 | 0.001 | ||
2026.06 | 0.633 | - | - | |
2026.06 | 0.633 | - | - | |
2026.06 | 0.624 | 0.559 | 0.001 | |
2026.06 | 0.541 | - | - |