Code Completion on MBPP+ (Pass@1)
65.6Pass@1
PrivCode
Updated 4d ago
Evaluation Results
| Method | Links | |
|---|---|---|
2025.12 | 65.6 | |
2025.12 | 62.7 | |
2025.12 | 61.4 | |
2025.12 | 60.6 | |
2025.12 | 60.1 | |
2024.02 | 59.1 | |
2025.12 | 58.2 | |
2025.12 | 56.9 | |
2024.02 | 56.6 | |
2025.12 | 56.1 | |
2025.12 | 54.8 | |
2025.12 | 54.5 | |
2025.12 | 54.1 | |
2025.12 | 54.1 | |
2025.12 | 53.7 | |
2024.02 | 53.1 | |
2025.12 | 52.9 | |
2024.02 | 52.4 | |
2024.02 | 52.4 | |
2025.12 | 50.3 | |
2025.12 | 49.5 | |
2024.02 | 47.4 | |
2024.02 | 46.9 | |
2025.12 | 46.8 | |
2025.12 | 46.6 | |
2024.02 | 45.6 | |
2024.02 | 43.6 | |
2024.02 | 43.1 | |
2024.02 | 41.6 | |
2025.12 | 40.1 | |
2024.02 | 39.6 | |
2025.12 | 36.2 | |
2024.02 | 35.8 |