Code Generation on MBPP 3-shot (test)
47.4Pass@1
ESPO
Updated 4d ago
Evaluation Results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
2025.12 | 47.4 | - | - | - | - | - | - | |
2025.12 | 44.6 | - | - | - | - | - | - | |
2025.12 | 44.2 | - | - | - | - | - | - | |
2025.12 | 39.9 | - | - | - | - | - | - | |
2025.12 | 39.6 | - | - | - | - | - | - | |
2025.12 | 38.8 | - | - | - | - | - | - | |
2025.12 | 38.2 | - | - | - | - | - | - | |
2025.12 | 38.2 | - | - | - | - | - | - | |
2025.12 | 38 | - | - | - | - | - | - | |
2025.12 | 38 | - | - | - | - | - | - | |
2025.12 | 37.2 | - | - | - | - | - | - | |
2025.12 | 37 | - | - | - | - | - | - | |
2025.12 | 36.6 | - | - | - | - | - | - | |
2025.12 | 34.8 | - | - | - | - | - | - | |
2025.12 | 34.4 | - | - | - | - | - | - | |
2025.12 | - | 37.8 | - | - | - | - | - | |
2025.12 | - | 36.5 | - | - | - | - | - | |
2025.12 | - | 36.5 | - | - | - | - | - | |
2025.12 | - | 45.4 | - | - | - | - | - | |
2025.12 | - | 39.4 | - | - | - | - | - | |
2026.01 | - | - | 29.4 | 29.4 | 1 | - | - | |
2026.01 | - | - | 26.2 | 17.6 | 1.7 | - | - | |
2026.01 | - | - | 29.6 | 8.6 | 3.4 | - | - | |
2026.01 | - | - | 28.2 | 3.8 | 7.7 | - | - | |
2026.01 | - | - | 42 | 0.9 | 32.7 | - | - | |
2026.01 | - | - | 14.8 | 70.5 | 1 | - | - | |
2026.01 | - | - | 14.6 | 43.3 | 1.6 | - | - | |
2026.01 | - | - | 13.4 | 23.6 | 3 | - | - | |
2026.01 | - | - | 13.8 | 7.6 | 9.3 | - | - | |
2026.01 | - | - | 40.8 | 1.1 | 64.1 | - | - | |
2025.09 | - | - | - | 4.64 | 48.3 | 119.81 | 40.2 | |
2025.09 | - | - | - | 5.11 | 39.7 | 108.39 | 52.8 |