Software Engineering on SWE-Bench Verified (Pass@K)
84Pass@1
Mini-SWE
Updated 3d ago
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
2026.02 | 84 | 89 | 54.76 | |
2026.02 | 82 | 86 | 71.62 | |
2026.02 | 76 | 82 | 58.43 | |
2025.12 | 74.6 | - | - | |
2025.12 | 72.8 | - | - | |
2025.12 | 70.6 | - | - | |
2026.02 | 70 | 84 | 55.44 | |
2026.02 | 68 | 83 | 45.13 | |
2025.12 | 66.6 | - | - | |
2026.02 | 64 | 82 | 47.22 | |
2026.02 | 63 | 87 | 43.62 | |
2026.02 | 60 | 75 | 48.35 | |
2026.02 | 56 | 85 | 49.49 | |
2026.02 | 48 | 87 | 38.23 | |
2026.02 | 48 | 66 | 48.49 | |
2026.02 | 44 | 83 | 36.3 | |
2026.02 | 25 | 41 | 29.65 | |
2026.02 | 22 | 42 | 27.43 | |
2026.04 | - | 73 | - | |
2026.04 | - | 75 | - | |
2026.04 | - | 72 | - | |
2026.04 | - | 77 | - |