Code Evaluation on SWE Verified Agentless
57.6pass@1
DeepSeek-R1 0528 671B
Updated 1mo ago
Evaluation Results
| Method | Links | |
|---|---|---|
2025.12 | 57.6 | |
| 53.8 | ||
2025.12 | 48.9 | |
| 43.6 | ||
| 43.1 | ||
2025.12 | 37.2 | |
2025.12 | 27.4 | |
2025.12 | 20.5 |
DeepSeek-R1 0528 671B
| Method | Links | |
|---|---|---|
2025.12 | 57.6 | |
| 53.8 | ||
2025.12 | 48.9 | |
| 43.6 | ||
| 43.1 | ||
2025.12 | 37.2 | |
2025.12 | 27.4 | |
2025.12 | 20.5 |