Code Generation on MBPP (tau, Speed, Score)
3.97Speedup
CoSpec
Updated 8d ago
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
2026.05 | 3.97 | 21.13 | 90.11 | |
2026.05 | 3.92 | 20.96 | 91.39 | |
2026.05 | 3.77 | 5.45 | 89.18 | |
2026.05 | 3.58 | 5.15 | 88.73 | |
2026.05 | 2.69 | 12.33 | 88.42 | |
2026.05 | 2.45 | 11.76 | 88.62 | |
2026.05 | 2.01 | 2.34 | 89.18 | |
2026.05 | 1.97 | 18.01 | 79.1 | |
2026.05 | 1.96 | 17.97 | 80.09 | |
2026.05 | 1.94 | 2.24 | 88.73 | |
2026.05 | 1.91 | 3.89 | 75.92 | |
2026.05 | 1.83 | 3.8 | 76.11 | |
2026.05 | 1.75 | 2.16 | 89.4 | |
2026.05 | 1.72 | 2.08 | 90.03 | |
2026.05 | 1.68 | 10.43 | 89.18 | |
2026.05 | 1.59 | 2.03 | 75.6 | |
2026.05 | 1.58 | 10.55 | 75.42 | |
2026.05 | 1.58 | 10.12 | 75.38 | |
2026.05 | 1.58 | 2 | 75.72 | |
2026.05 | 1.51 | 6.08 | 88.73 | |
2026.05 | 1.33 | 9.52 | 75.92 | |
2026.05 | 1.27 | 9.41 | 76.11 | |
2026.05 | 1 | 1 | 89.18 | |
2026.05 | 1 | 1 | 75.92 | |
2026.05 | 1 | 1 | 88.73 | |
2026.05 | 1 | 1 | 76.11 |