Code Generation on MBPP (Acc. %, RSR %)
96.6Accuracy
EG-CFG
Updated 4d ago
Evaluation Results
| Method | Links | ||
|---|---|---|---|
2025.06 | 96.6 | 80.23 | |
2025.06 | 94.2 | - | |
2025.06 | 88.7 | - | |
2025.06 | 87.7 | - | |
2025.06 | 87.2 | 25.58 | |
2025.06 | 86.8 | 23.25 | |
2025.06 | 84.8 | - | |
2025.06 | 84 | 6.97 | |
2025.06 | 83.2 | 66.79 | |
2025.06 | 83.1 | - | |
2025.06 | 82.8 | 0 | |
2025.06 | 80.8 | - | |
2025.06 | 80.6 | - | |
2025.06 | 80 | - | |
2025.06 | 78.9 | - | |
2025.12 | 74.3 | - | |
2025.12 | 73.8 | - | |
2025.12 | 73.2 | - | |
2025.12 | 72.6 | - | |
2025.12 | 72.5 | - | |
2025.12 | 71.9 | - | |
2025.12 | 71.7 | - | |
2025.12 | 71.2 | - | |
2025.12 | 71.1 | - | |
2025.12 | 70.8 | - | |
2025.12 | 70.5 | - | |
2025.06 | 70.4 | 41.5 | |
2025.12 | 69.8 | - | |
2025.12 | 69.1 | - | |
2025.12 | 68.4 | - | |
2025.12 | 68.4 | - | |
2025.06 | 68.3 | - | |
2025.12 | 66.8 | - | |
2025.12 | 66.2 | - | |
2025.12 | 65.9 | - | |
2025.12 | 65.6 | - | |
2025.12 | 65 | - | |
2025.12 | 64.9 | - | |
2025.12 | 64.7 | - | |
2025.12 | 64.3 | - | |
2025.12 | 64.2 | - | |
2025.12 | 63.7 | - | |
2025.12 | 63.7 | - | |
2025.12 | 63.7 | - | |
2025.12 | 63.1 | - | |
2025.12 | 63.1 | - | |
2025.12 | 63 | - | |
2025.12 | 62.5 | - | |
2025.12 | 62.4 | - | |
2025.12 | 62.4 | - | |
2025.12 | 62.4 | - | |
2025.12 | 61.8 | - | |
2025.12 | 61.7 | - | |
2025.12 | 61.5 | - | |
2025.12 | 61.2 | - | |
2025.12 | 60.9 | - | |
2025.12 | 60.5 | - | |
2025.12 | 60.5 | - | |
2025.12 | 60.3 | - | |
2025.12 | 59.8 | - | |
2025.12 | 59.7 | - | |
2025.12 | 59.4 | - | |
2025.12 | 59.1 | - | |
2025.12 | 59.1 | - | |
2025.12 | 58.7 | - | |
2025.12 | 58.4 | - | |
2025.12 | 58.4 | - | |
2025.12 | 57.8 | - | |
2025.12 | 57.2 | - | |
2025.12 | 56.8 | - | |
2025.12 | 56.7 | - | |
2025.12 | 55.8 | - | |
2025.06 | 55.2 | 11.46 | |
2025.12 | 54.3 | - | |
2026.02 | 49.6 | - | |
2025.06 | 49.4 | 0 | |
2026.02 | 48 | - | |
2026.02 | 47.6 | - | |
2026.02 | 47 | - | |
2026.02 | 47 | - | |
2026.02 | 46.6 | - | |
2026.02 | 43.8 | - | |
2026.02 | 39.2 | - | |
2026.02 | 38.8 | - | |
2026.02 | 37.4 | - | |
2026.02 | 9.2 | - | |
2026.02 | 6.8 | - | |
2026.02 | 6.2 | - | |
2026.02 | 4.8 | - | |
2026.02 | 4.6 | - |