Code Generation on MBPP (Acc., TPS)
56.4Accuracy
DSB Cache (greedy)
Updated 1mo ago
Evaluation Results
| Method | Links | ||
|---|---|---|---|
2026.02 | 56.4 | 61.85 | |
2026.02 | 56 | 55.67 | |
2026.02 | 55.8 | 60.54 | |
2026.02 | 55.4 | 62.03 | |
2026.02 | 55 | 108.5 | |
2026.02 | 54.8 | 115.3 | |
2026.02 | 54.2 | 13.54 | |
2026.02 | 54 | 80.3 | |
2026.02 | 53.8 | 80.76 | |
2026.02 | 53.8 | 76.9 | |
2026.02 | 53.8 | 57.94 | |
2026.02 | 53 | 29.01 | |
2026.02 | 53 | 101.1 | |
2026.02 | 52 | 59.48 | |
2026.02 | 39.2 | 5.32 | |
2026.02 | 39.2 | 31.08 | |
2026.02 | 37 | 47.61 | |
2026.02 | 36.6 | 30.58 | |
2026.02 | 34.8 | 29.62 | |
2026.02 | 34.2 | 50.61 | |
2026.02 | 34 | 48.04 | |
2026.02 | 31 | 53.56 | |
2026.02 | 30.8 | 53.35 | |
2026.02 | 29.6 | 52.72 | |
2026.02 | 29.4 | 14.33 | |
2026.02 | 27.8 | 82.02 | |
2026.02 | 27.4 | 81.88 | |
2026.02 | 25.2 | 76.61 |