Code Infilling on HumanEval Infilling
57.12Pass@1 Mean
A2D2
Updated 1mo ago
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
2026.06 | 57.12 | - | - | - | |
2026.06 | 53.73 | - | - | - | |
2026.06 | 53.44 | - | - | - | |
2026.02 | 51.3 | 23.2 | 81.6 | 53.8 | |
2026.06 | 49.37 | - | - | - | |
2026.06 | 48.89 | - | - | - | |
2026.06 | 47.53 | - | - | - | |
2026.06 | 44.82 | - | - | - | |
2026.02 | 44.8 | 19.6 | 76.7 | 46.3 | |
2026.06 | 44.14 | - | - | - | |
2026.02 | 40.8 | 21.5 | 71.3 | 41.4 | |
2026.02 | 39.1 | 14.3 | 55.5 | 43.2 | |
2026.02 | 37.9 | 21.6 | 73.5 | 36.1 | |
2026.02 | 36.7 | 19.1 | 69.4 | 35.9 | |
2026.02 | 36.1 | 20.5 | 68.9 | 34.6 | |
2026.02 | 35.1 | 14.6 | 48.8 | 38.4 | |
2026.02 | 31.2 | 16.5 | 48.8 | 32.2 | |
2026.02 | 23.4 | 16 | 48.3 | 21.1 | |
2026.02 | 22.5 | 8.17 | 48.2 | 21.9 | |
2026.02 | - | - | 65 | - |