Code Generation on MBPP (Throughput, Latency(s))
58Score
d2Cache
Updated 2d ago
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
2025.09 | 58 | 12.47 | 40.32 | |
2026.02 | 52.56 | - | - | |
2025.09 | 52.4 | 7.07 | 71.13 | |
2025.09 | 52 | 2.73 | 182.78 | |
2025.09 | 52 | 7.29 | 69.47 | |
2026.02 | 50.86 | - | - | |
2026.02 | 46.88 | - | - | |
2026.02 | 46.65 | - | - | |
2026.02 | 46.33 | - | - | |
2026.02 | 45.57 | - | - | |
2026.02 | 45.18 | - | - | |
2026.02 | 45.05 | - | - | |
2026.02 | 44.73 | - | - | |
2026.02 | 44.63 | - | - | |
2026.02 | 43.87 | - | - | |
2026.02 | 43.84 | - | - | |
2026.02 | 43.35 | - | - | |
2026.02 | 43.03 | - | - | |
2026.02 | 42.19 | - | - | |
2026.02 | 42.14 | - | - | |
2026.02 | 41.53 | - | - | |
2026.02 | 41.04 | - | - | |
2026.02 | 40.97 | - | - | |
2026.02 | 40.49 | - | - | |
2026.02 | 40.42 | - | - | |
2026.02 | 40.11 | - | - | |
2026.02 | 39.75 | - | - | |
2025.09 | 39.4 | 11.42 | 43.86 | |
2026.02 | 39.27 | - | - | |
2026.02 | 38.93 | - | - | |
2025.09 | 38.4 | 6.8 | 73.27 | |
2025.09 | 38 | 2.48 | 199.9 | |
2025.09 | 38 | 6.97 | 71.79 | |
2026.02 | 37.34 | - | - | |
2026.02 | 36.28 | - | - | |
2026.02 | 36.22 | - | - | |
2026.02 | 34.58 | - | - | |
2026.02 | 32.03 | - | - |