Software Engineering Efficiency on SWE-bench Lite (Speedup, Mean acceptance length (τ))
4.66Speedup
Draft-OPD
Updated 1mo ago
Evaluation Results
| Method | Links | ||
|---|---|---|---|
2026.05 | 4.66 | 5.96 | |
2026.04 | 4.38 | 5.71 | |
2026.05 | 4.31 | 5.73 | |
2026.04 | 4.25 | 5.99 | |
2026.04 | 4.23 | 5.91 | |
2026.05 | 4.12 | 5.51 | |
2026.04 | 3.8 | 4.96 | |
2026.05 | 3.72 | 5.19 | |
2026.04 | 3.71 | 5.2 | |
2026.04 | 3.47 | 4.86 | |
2026.05 | 3.47 | 5.33 | |
2026.05 | 3.38 | 5.64 | |
2026.05 | 3.38 | 5.13 | |
2026.05 | 3.33 | 6.57 | |
2026.05 | 3.18 | 6.6 | |
2026.05 | 3.17 | 4.77 | |
2026.05 | 3.17 | 6.04 | |
2026.05 | 3.13 | 5.05 | |
2026.05 | 3.05 | 6.04 | |
2026.05 | 3.03 | 6.02 | |
2026.05 | 2.9 | 6.13 | |
2026.05 | 2.88 | 4.66 | |
2026.05 | 2.85 | 5.62 | |
2026.05 | 2.83 | 5.33 | |
2026.04 | 2.77 | 3.61 | |
2026.05 | 2.77 | 5.73 | |
2026.05 | 2.75 | 5.03 | |
2026.04 | 2.7 | 3.66 | |
2026.05 | 2.67 | 5.99 | |
2026.04 | 2.65 | 3.6 | |
2026.05 | 2.54 | 5.84 | |
2026.05 | 2.43 | 5.69 | |
2026.04 | 2.42 | 3.16 | |
2026.05 | 2.41 | 5.66 | |
2026.04 | 2.29 | 3.07 | |
2026.04 | 2.1 | 2.82 |