Code Generation on MBPP Plus 3-shot (test)
42.6Pass@1
ESPO
Updated 4d ago
Evaluation Results
| Method | Links | ||
|---|---|---|---|
2025.12 | 42.6 | - | |
2025.12 | 41.6 | - | |
2025.12 | 40.4 | - | |
2025.12 | 39.4 | - | |
2025.12 | 38.9 | - | |
2025.12 | 38.8 | - | |
2025.12 | 37.8 | - | |
2025.12 | 37.3 | - | |
2025.12 | 36.8 | - | |
2025.12 | 36.8 | - | |
2025.12 | 35.6 | - | |
2025.12 | 34.8 | - | |
2025.12 | 32.8 | - | |
2025.12 | 31.8 | - | |
2025.12 | 31.8 | - | |
2025.12 | - | 37.1 | |
2025.12 | - | 35.3 | |
2025.12 | - | 33.4 | |
2025.12 | - | 41 | |
2025.12 | - | 38.8 |