Program Synthesis on MBPP (Clean Error, ASR)
88.4ASR
No trust
Updated 3d ago
Evaluation Results
| Method | Links | ||
|---|---|---|---|
2025.06 | 88.4 | - | |
2025.06 | 83.4 | - | |
2025.06 | 73.5 | - | |
2025.06 | 65.1 | - | |
2025.06 | 62.4 | - | |
2025.06 | 56.2 | - | |
2025.06 | 45.7 | - | |
2025.06 | 45.2 | - | |
2025.06 | 43.1 | - | |
2025.06 | 22.8 | - | |
2025.06 | 19.5 | - | |
2025.06 | 17.2 | - | |
2025.06 | - | 35.9 | |
2025.06 | - | 37.5 | |
2025.06 | - | 28.7 | |
2025.06 | - | 32.8 | |
2025.06 | - | 29.5 | |
2025.06 | - | 31.1 |