Software Engineering Task Success on SWE-Skills-Bench Hard
35Task Success Rate
Revision v3
Updated 1d ago
Evaluation Results
| Method | Links | ||
|---|---|---|---|
2026.05 | 35 | 18.57 | |
2026.05 | 33 | 7.14 | |
2026.05 | 32 | - | |
2026.05 | 31 | -1.43 | |
2026.05 | 30 | 10 | |
2026.05 | 29 | 1.43 | |
2026.05 | 28 | - | |
2026.05 | 28 | 7.14 | |
2026.05 | 27 | -1.43 | |
2026.05 | 27 | 2.86 | |
2026.05 | 26 | 6.25 | |
2026.05 | 25 | -10 | |
2026.05 | 25 | - | |
2026.05 | 25 | 2.86 | |
2026.05 | 24 | 2.86 | |
2026.05 | 23 | -12.86 | |
2026.05 | 23 | 6.88 | |
2026.05 | 23 | - | |
2026.05 | 22 | - | |
2026.05 | 20 | -7.14 |