Code Generation on MBPP (tokens/s, speedup)
32.93Tokens/s
PACER
Updated 4d ago
Evaluation Results
| Method | Links | ||
|---|---|---|---|
2026.02 | 32.93 | 1.88 | |
2026.02 | 30.72 | 1.75 | |
2026.02 | 29.55 | 1.69 | |
2026.02 | 29.41 | 1.69 | |
2026.02 | 28.57 | 1.8 | |
2026.02 | 26.62 | 1.68 | |
2026.02 | 26.6 | 1.52 | |
2026.02 | 25.64 | 1.6 | |
2026.02 | 23.67 | 1.49 | |
2026.02 | 21.07 | 1.33 | |
2026.02 | 19.9 | 2.14 | |
2026.02 | 18.65 | 2.01 | |
2026.02 | 17.53 | 1 | |
2026.02 | 16.3 | 1.76 | |
2026.02 | 15.86 | 1 | |
2026.02 | 15.38 | 1.66 | |
2026.02 | 13.3 | 1.43 | |
2026.02 | 9.28 | 1 |