Code Infilling on HumanEval random span
74.2pass@1 (PSM)
code-davinci-002
Updated 1mo ago
Evaluation Results
| Method | Links | ||
|---|---|---|---|
2023.08 | 74.2 | - | |
2023.08 | 64.3 | 42.7 | |
2023.08 | 63.6 | 41.9 | |
2023.08 | 60.7 | 39.6 | |
2023.08 | 59.7 | 39 | |
2023.08 | 55.1 | - |
code-davinci-002
| Method | Links | ||
|---|---|---|---|
2023.08 | 74.2 | - | |
2023.08 | 64.3 | 42.7 | |
2023.08 | 63.6 | 41.9 | |
2023.08 | 60.7 | 39.6 | |
2023.08 | 59.7 | 39 | |
2023.08 | 55.1 | - |