Software Engineering on SWE-Bench Lite (Acc, Cost)
57.09Accuracy
CoT-SC
Updated 1mo ago
Evaluation Results
| Method | Links | ||
|---|---|---|---|
2026.06 | 57.09 | 286.4 | |
2026.06 | 55.97 | 227.4 | |
2026.06 | 45.52 | 998.2 | |
2026.06 | 43.91 | 14.9 | |
2026.06 | 41.79 | 83.5 | |
2026.06 | 39.05 | 997.5 | |
2026.06 | 32.71 | 95.4 | |
2026.06 | 28.7 | 47.17 | |
2026.06 | 27.6 | 327.4 | |
2026.06 | 27.23 | 124.5 | |
2026.06 | 26.5 | 240.56 | |
2026.06 | 26.5 | 214 | |
2026.06 | 22.01 | 168.3 | |
2026.06 | 20.5 | 206.27 | |
2026.06 | 20.02 | 25.6 | |
2026.06 | 19.28 | 230.8 | |
2026.06 | 17.55 | 82.7 | |
2026.06 | 17.5 | - | |
2026.06 | 15.17 | 1,210.9 | |
2026.06 | 12.19 | 35.6 | |
2026.06 | 10.57 | 903.2 | |
2026.06 | 8.97 | 104.4 | |
2026.06 | 0 | 434 |