Code Synthesis on HumanEval
36pass@1
Davinci Codex
Updated 1mo ago
Evaluation Results
| Method | Links | ||
|---|---|---|---|
2022.04 | 36 | 81.7 | |
2022.04 | 36 | 88.4 | |
2022.04 | 28.8 | 72.3 | |
2022.04 | 26.2 | 76.2 | |
2022.04 | 14 | 47.3 |
Davinci Codex
| Method | Links | ||
|---|---|---|---|
2022.04 | 36 | 81.7 | |
2022.04 | 36 | 88.4 | |
2022.04 | 28.8 | 72.3 | |
2022.04 | 26.2 | 76.2 | |
2022.04 | 14 | 47.3 |