Code Generation on MBPP (Pass@1, Pass@10, Pass@100)
23.1Pass@1
PASER
Updated 3d ago
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
2025.02 | 23.1 | 42.6 | 62 | |
2025.02 | 22.3 | 41 | 63.7 | |
2025.02 | 18.9 | 35.8 | 52.4 | |
2025.02 | 18.2 | 34.5 | 50.7 | |
2025.02 | 17.6 | 32.6 | 51.9 | |
2025.02 | 16.4 | 30.8 | 52.4 | |
2025.02 | 15.7 | 29.2 | 43.1 | |
2025.02 | 15.2 | 26.3 | 39.5 | |
2025.02 | 12.8 | 23.8 | 35 | |
2025.02 | 12.8 | 24.5 | 45.2 | |
2025.02 | 9.3 | 19.7 | 36.4 | |
2025.02 | 8.5 | 17.2 | 38.6 | |
2025.02 | 7.1 | 15.5 | 24.6 | |
2025.02 | 6.2 | 11.8 | 21.5 |