Code Generation on MBPP problems 11-510 (test)
50.4Pass@1
Code-davinci-002
Updated 4d ago
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
2023.03 | 50.4 | - | 84.4 | |
2023.03 | 47 | - | 80.8 | |
2023.03 | 36.8 | - | 75 | |
2023.03 | 24.37 | 47.95 | 68.5 | |
2023.03 | 22.44 | 43.24 | 63.52 | |
2023.03 | 19.4 | - | - | |
2023.03 | 14.8 | - | 62.4 |