Code Synthesis on MBPP (pass@1, pass@80)
50.4Pass@1
Davinci Codex
Updated 1mo ago
Evaluation Results
| Method | Links | ||
|---|---|---|---|
2022.04 | 50.4 | 84.4 | |
2022.04 | 47 | 80.8 | |
2022.04 | 36.8 | 75 | |
2022.04 | 14.8 | 62.4 |
Davinci Codex
| Method | Links | ||
|---|---|---|---|
2022.04 | 50.4 | 84.4 | |
2022.04 | 47 | 80.8 | |
2022.04 | 36.8 | 75 | |
2022.04 | 14.8 | 62.4 |