Code Generation on MBPP (Acc, TPF, AUP)
63.6Accuracy
Qwen-2.5-7B-it
Updated 1mo ago
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
2026.03 | 63.6 | 1 | 63.6 | |
2026.03 | 60.2 | 5.69 | 298.6 | |
2026.03 | 58.3 | 11.1 | 641.6 | |
2026.03 | 58 | 2.44 | 81.1 | |
2026.03 | 57.2 | 1 | 57.2 | |
2026.03 | 55.6 | 2.96 | 141.4 | |
2026.03 | 55.4 | 2.24 | 108 | |
2026.03 | 53.2 | 1.2 | 63.6 | |
2026.03 | 50.1 | 2.04 | 81.9 | |
2026.03 | 47.1 | 1 | 47.1 | |
2026.03 | 40.6 | 4.21 | 88.4 | |
2026.03 | 40 | 2.35 | 60.5 | |
2026.03 | 38.6 | 2.13 | 56.6 | |
2026.03 | 38 | 1.94 | 50 |