Code Generation on MBPP Python
69.8Pass@1
INTERVENOR
Updated 1mo ago
Evaluation Results
| Method | Links | |
|---|---|---|
2023.11 | 69.8 | |
2023.11 | 68.2 | |
2023.11 | 61.2 | |
2023.11 | 51.8 | |
2023.11 | 49.5 | |
2023.11 | 47 | |
2023.11 | 45.4 | |
2023.11 | 39.8 | |
2023.11 | 24.4 | |
2023.11 | 20.9 | |
2023.11 | 19.4 |
INTERVENOR
| Method | Links | |
|---|---|---|
2023.11 | 69.8 | |
2023.11 | 68.2 | |
2023.11 | 61.2 | |
2023.11 | 51.8 | |
2023.11 | 49.5 | |
2023.11 | 47 | |
2023.11 | 45.4 | |
2023.11 | 39.8 | |
2023.11 | 24.4 | |
2023.11 | 20.9 | |
2023.11 | 19.4 |