Code Reasoning on MBPP
84.7MBPP Execution Accuracy
Qwen2.5-Coder-CFB-Aug
Updated 8d ago
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
2024.10 | 84.7 | 69.3 | - | - | |
2024.10 | 83.1 | 69.9 | - | - | |
2024.10 | 77.2 | 64 | - | - | |
2025.12 | 73.8 | - | - | - | |
2025.12 | 73.2 | - | - | - | |
2025.12 | 72.6 | - | - | - | |
2025.12 | 72.6 | - | - | - | |
2025.12 | 72.1 | - | - | - | |
2025.12 | 71.9 | - | - | - | |
2025.12 | 71.7 | - | - | - | |
2025.12 | 71.6 | - | - | - | |
2025.12 | 71.2 | - | - | - | |
2025.12 | 71 | - | - | - | |
2025.12 | 70.5 | - | - | - | |
2025.12 | 70.4 | - | - | - | |
2025.12 | 70.3 | - | - | - | |
2025.12 | 70 | - | - | - | |
2025.12 | 69.6 | - | - | - | |
2025.12 | 69.5 | - | - | - | |
2025.12 | 69.5 | - | - | - | |
2025.12 | 68.9 | - | - | - | |
2025.12 | 68.9 | - | - | - | |
2025.12 | 68.8 | - | - | - | |
2025.12 | 68.5 | - | - | - | |
2025.12 | 68.3 | - | - | - | |
2025.12 | 67.8 | - | - | - | |
2025.12 | 67.1 | - | - | - | |
2025.12 | 66.9 | - | - | - | |
2025.12 | 66.4 | - | - | - | |
2025.12 | 64.7 | - | - | - | |
2025.12 | 59.3 | - | - | - | |
2025.12 | 58.7 | - | - | - | |
2025.12 | 25 | - | - | - | |
2026.05 | - | - | 61 | 66.7 | |
2026.05 | - | - | 63.2 | 66.7 | |
2026.05 | - | - | 62.2 | 65.7 | |
2026.05 | - | - | 62.6 | 64.6 | |
2026.05 | - | - | 64 | 66.67 | |
2026.05 | - | - | 64 | 65.66 | |
2026.05 | - | - | 66.2 | 66.67 | |
2026.05 | - | - | 62.3 | 67.68 | |
2026.05 | - | - | 68 | 50.5 | |
2026.05 | - | - | 66.8 | 32.32 | |
2026.05 | - | - | 38.2 | 27.27 | |
2026.05 | - | - | 56.3 | 12.12 | |
2026.05 | - | - | 59 | 67.7 | |
2026.05 | - | - | 60.8 | 68.7 | |
2026.05 | - | - | 58.2 | 67.7 | |
2026.05 | - | - | 61.7 | 68.7 |