Software Engineering on SWE-Bench Pro (public)
64.3Resolve Rate (Pass@1)
Claude Opus 4.7
Updated 1mo ago
Evaluation Results
| Method | Links | ||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
2026.06 | 64.3 | - | - | - | - | - | - | - | - | - | - | - | |
2026.06 | 59.1 | - | - | - | - | - | - | - | - | - | - | - | |
2025.12 | 59 | - | - | - | - | - | - | - | - | - | - | - | |
2025.12 | 56 | - | - | - | - | - | - | - | - | - | - | - | |
2025.12 | 54.3 | - | - | - | - | - | - | - | - | - | - | - | |
2026.06 | 54.2 | - | - | - | - | - | - | - | - | - | - | - | |
2025.12 | 52.7 | - | - | - | - | - | - | - | - | - | - | - | |
2025.12 | 52 | - | - | - | - | - | - | - | - | - | - | - | |
2026.06 | 51.9 | - | - | - | - | - | - | - | - | - | - | - | |
2026.06 | 50.9 | - | - | - | - | - | - | - | - | - | - | - | |
2026.05 | 50.2 | 56.2 | 63.7 | 68.4 | 32.9 | 35.5 | 56.5 | 45.6 | 38.5 | 50 | 72.7 | 0 | |
2026.05 | 49 | 51 | 59.3 | 68.4 | 32.9 | 38.2 | 56.5 | 49.1 | 38.5 | 51.8 | 61.4 | 0 | |
2026.05 | 47.6 | 49 | 64.8 | 62 | 32.9 | 34.2 | 54.8 | 49.1 | 43.1 | 50 | 47.7 | 0 | |
2026.05 | 46.9 | 52.1 | 55 | 64.6 | 31.8 | 35.5 | 50 | 50.9 | 38.5 | 46.4 | 61.4 | 0 | |
2026.06 | 46.1 | - | - | - | - | - | - | - | - | - | - | - | |
2025.12 | 45.8 | - | - | - | - | - | - | - | - | - | - | - | |
2025.12 | 45.5 | - | - | - | - | - | - | - | - | - | - | - | |
2025.12 | 43.6 | - | - | - | - | - | - | - | - | - | - | - | |
2025.12 | 42.7 | - | - | - | - | - | - | - | - | - | - | - |