Code Completion on CVDP non-agentic 1.0
24.47Pass@1
GPT-o4 Mini
Updated 3mo ago
Evaluation Results
| Method | Links | |
|---|---|---|
2025.12 | 24.47 | |
2025.12 | 17.02 | |
2025.12 | 9.57 | |
2025.12 | 4.26 | |
2025.12 | 1.03 | |
2025.12 | 1.03 | |
2025.12 | 0 | |
2025.12 | 0 | |
2025.12 | 0 | |
2025.12 | 0 |
GPT-o4 Mini
| Method | Links | |
|---|---|---|
2025.12 | 24.47 | |
2025.12 | 17.02 | |
2025.12 | 9.57 | |
2025.12 | 4.26 | |
2025.12 | 1.03 | |
2025.12 | 1.03 | |
2025.12 | 0 | |
2025.12 | 0 | |
2025.12 | 0 | |
2025.12 | 0 |