Issue Resolution on SWE-bench Verified (test)
77.2Pass Rate
Claude-4.5-Sonnet
Updated 4d ago
Evaluation Results
| Method | Links | |||||
|---|---|---|---|---|---|---|
2025.12 | 77.2 | - | - | - | - | |
2025.12 | 76.3 | - | - | - | - | |
2025.12 | 76.2 | - | - | - | - | |
2025.12 | 69.6 | - | - | - | - | |
2026.01 | 68.7 | 31.9 | 290 | 713,000 | - | |
2026.01 | 68.4 | 41.1 | 312 | 1,053,000 | - | |
2026.01 | 68.1 | 31.6 | 223 | 562,000 | - | |
2025.12 | 61 | - | - | - | - | |
2025.12 | 59.6 | - | - | - | - | |
2025.12 | 57.6 | - | - | - | - | |
2025.12 | 57.6 | - | - | - | - | |
2025.12 | 55.2 | - | - | - | - | |
2025.12 | 54.6 | - | - | - | - | |
2025.12 | 53.8 | - | - | - | - | |
2025.12 | 53 | - | - | - | - | |
2025.12 | 52.2 | - | - | - | - | |
2025.12 | 49.8 | - | - | - | - | |
2025.12 | 45.6 | - | - | - | - | |
2025.12 | 42.2 | - | - | - | - | |
2025.12 | 41 | - | - | - | - | |
2025.12 | 40.2 | - | - | - | - | |
2025.12 | 38.8 | - | - | - | - | |
2025.12 | 34.4 | - | - | - | - | |
2025.12 | 34.4 | - | - | - | - | |
2025.12 | 32.8 | - | - | - | - | |
2025.12 | 28.8 | - | - | - | - | |
2026.01 | 22.22 | - | - | - | 15.88 | |
2026.01 | 21.79 | - | - | - | 17.85 | |
2025.12 | 20.6 | - | - | - | - | |
2026.01 | 19.34 | - | - | - | 17.12 | |
2026.01 | 18.76 | - | - | - | 8.7 | |
2026.01 | 16.74 | - | - | - | 11.56 | |
2026.01 | 8.8 | - | - | - | 7.46 | |
2026.01 | 6.49 | - | - | - | 2.97 | |
2026.01 | 3.32 | - | - | - | 3.2 | |
2026.01 | 1.29 | - | - | - | 1.34 |