Code Generation on MBPP-ET
91.8Pass@1
AgentCoder
Updated 4d ago
Evaluation Results
| Method | Links | ||
|---|---|---|---|
2023.12 | 91.8 | 75.9 | |
2023.12 | 91.4 | 92.4 | |
2024.12 | 91.4 | - | |
2023.12 | 89.1 | 142.1 | |
2024.12 | 89.1 | - | |
2024.12 | 80.5 | - | |
2024.12 | 80 | - | |
2024.12 | 79.9 | - | |
2024.12 | 79.9 | - | |
2024.12 | 79.2 | - | |
2024.12 | 79.2 | - | |
2024.12 | 79.2 | - | |
2024.12 | 78.8 | - | |
2024.12 | 78.2 | - | |
2024.12 | 78.2 | - | |
2023.12 | 75.5 | 177.6 | |
2023.12 | 75.1 | 277.4 | |
| 75 | - | ||
| 75 | - | ||
2024.12 | 74.8 | - | |
| 74.7 | - | ||
2024.12 | 74.5 | - | |
2024.12 | 74.4 | - | |
2024.12 | 73.5 | - | |
2024.12 | 67.8 | - | |
2024.12 | 67.4 | - | |
2024.12 | 65.8 | - | |
2024.12 | 65.4 | - | |
2023.12 | 63 | 71.2 | |
2023.12 | 62.1 | 19 | |
2024.03 | 58.7 | - | |
2024.05 | 57.7 | - | |
2024.12 | 57.7 | - | |
2024.03 | 56.7 | - | |
2024.03 | 56.7 | - | |
2024.05 | 56.2 | - | |
2024.05 | 54.7 | - | |
2024.05 | 54.4 | - | |
2024.12 | 54.4 | - | |
2023.12 | 52.3 | 42.1 | |
2023.12 | 52.2 | - | |
2024.03 | 52 | - | |
2024.05 | 51.9 | - | |
2024.05 | 50.4 | - | |
2024.05 | 49.5 | - | |
2023.12 | 49.5 | 34.5 | |
2023.12 | 48.3 | 31.2 | |
2023.12 | 47.5 | - | |
2023.12 | 47.5 | 29.1 | |
2024.05 | 47.4 | - | |
2023.12 | 47.1 | 28 | |
2023.12 | 46.7 | 26.9 | |
2024.05 | 46.1 | - | |
2023.12 | 45.9 | 24.7 | |
2023.12 | 45.9 | 24.7 | |
2023.12 | 45.1 | - | |
2024.05 | 41.9 | - | |
2023.12 | 41.5 | 12.8 | |
2023.12 | 40.8 | 10.9 | |
2024.05 | 40.3 | - | |
2024.05 | 39.6 | - | |
2023.12 | 38.8 | - | |
2024.05 | 37.7 | - | |
2023.12 | 36.8 | - | |
2023.12 | 34.8 | -5.4 | |
2023.12 | 33.4 | - | |
2023.12 | 31.6 | - | |
2024.12 | 29.8 | - | |
2024.12 | 29.5 | - | |
2024.12 | 29 | - | |
2023.12 | 27.2 | - | |
2024.12 | 22.9 | - | |
2023.12 | 20.4 | - | |
2023.12 | 19.9 | - | |
2023.12 | 14.3 | - |