Code Generation on MBPP (tau, Speedup)
7.68Speedup
DFlash+DDTree
Updated 2d ago
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
2026.04 | 7.68 | 9.94 | - | - | |
2026.04 | 7.55 | 9.76 | - | - | |
2026.04 | 6.42 | 9.16 | - | - | |
2026.04 | 6.39 | 9.07 | - | - | |
2026.04 | 6.09 | 8.72 | - | - | |
2026.04 | 5.87 | 8.34 | - | - | |
2026.05 | 5.64 | - | - | 6.57 | |
2026.04 | 5.61 | 7.19 | - | - | |
2026.04 | 5.47 | 7.03 | - | - | |
2026.05 | 5.4 | - | - | 6.6 | |
2026.05 | 5.17 | - | - | 6.04 | |
2026.05 | 5.17 | - | - | 6.02 | |
2026.05 | 5 | - | - | 6.04 | |
2026.05 | 4.98 | - | - | 6.13 | |
2026.05 | 4.86 | - | - | 5.73 | |
2026.05 | 4.85 | - | - | 5.96 | |
2026.05 | 4.83 | - | - | 5.99 | |
2026.05 | 4.74 | - | - | 5.62 | |
2026.05 | 4.72 | - | - | 5.73 | |
2026.05 | 4.55 | - | - | 5.64 | |
2026.05 | 4.55 | - | - | 5.84 | |
2026.05 | 4.5 | - | - | 5.19 | |
2026.05 | 4.4 | - | - | 5.69 | |
2026.05 | 4.39 | - | - | 5.51 | |
2026.04 | 4.38 | 6.1 | - | - | |
2026.04 | 4.33 | 5.99 | - | - | |
2026.05 | 4.29 | - | - | 5.33 | |
2026.05 | 4.21 | - | - | 5.13 | |
2026.05 | 4.17 | - | - | 5.05 | |
2026.04 | 4.03 | 5.56 | - | - | |
2026.05 | 3.98 | - | - | 5.66 | |
2026.05 | 3.93 | - | - | 5.33 | |
2026.05 | 3.92 | - | - | 4.77 | |
2026.05 | 3.85 | - | - | 4.66 | |
2026.04 | 3.83 | 5.3 | - | - | |
2026.05 | 3.75 | - | - | 5.03 | |
2026.04 | 3.41 | 5.3 | - | - | |
2026.03 | 3.18 | 5.43 | - | - | |
2026.04 | 3 | 3.61 | - | - | |
2026.04 | 2.92 | 4.83 | - | - | |
2026.04 | 2.84 | 3.4 | - | - | |
2026.03 | 2.82 | 4.93 | - | - | |
2026.03 | 2.8 | 4.9 | - | - | |
2026.03 | 2.76 | 4.78 | - | - | |
2026.04 | 2.7 | 3.2 | - | - | |
2026.04 | 2.66 | 3.11 | - | - | |
2026.04 | 2.6 | 3.11 | - | - | |
2026.03 | 2.48 | 4.92 | - | - | |
2026.04 | 2.43 | 2.81 | - | - | |
2026.04 | 2.41 | 2.86 | - | - | |
2026.04 | 2.41 | 4.83 | - | - | |
2026.04 | 2.4 | 2.78 | - | - | |
2026.04 | 2.35 | 2.74 | - | - | |
2026.03 | 2.23 | 4.32 | - | - | |
2026.03 | 2.22 | 4.3 | - | - | |
2026.03 | 2.18 | 4.25 | - | - | |
2026.04 | 1.95 | 2.29 | - | - | |
2026.04 | 1.79 | 1.86 | - | - | |
2026.04 | 1.75 | 1.78 | - | - | |
2026.04 | 1.75 | 1.68 | - | - | |
2026.04 | 1.67 | 1.72 | - | - | |
2026.04 | 1.64 | 1.67 | - | - | |
2026.04 | 1.59 | 1.62 | - | - | |
2026.04 | 1.51 | 1.49 | - | - | |
2026.04 | 1.49 | 1.51 | - | - | |
2026.04 | 1.45 | 1.5 | - | - | |
2026.04 | 1.27 | 1.3 | - | - | |
2026.03 | 1.21 | 1.85 | - | - | |
2026.04 | 1.11 | 1.04 | - | - | |
2026.04 | 1.08 | 1.05 | - | - | |
2026.04 | 1.05 | 1.05 | - | - | |
2026.04 | 1.04 | 1.04 | - | - | |
2026.04 | 1.01 | 1.01 | - | - | |
2026.04 | 1 | 1 | - | - | |
2026.04 | 1 | 1 | - | - | |
2026.04 | 1 | 1 | - | - | |
2026.04 | 1 | 1 | - | - | |
2026.04 | 1 | 1 | - | - | |
2026.03 | 0.79 | 1.3 | - | - | |
2026.05 | - | 3.28 | 2.53 | - | |
2026.05 | - | 3.68 | 2.84 | - | |
2026.05 | - | 3.22 | 2.4 | - | |
2026.05 | - | 3.56 | 2.65 | - | |
2025.10 | - | - | 0.218 | - | |
2025.10 | - | - | 0.291 | - | |
2025.10 | - | - | 0.323 | - | |
2025.10 | - | - | 0.197 | - | |
2025.10 | - | - | 0.285 | - | |
2025.10 | - | - | 0.329 | - | |
2025.10 | - | - | 0.201 | - | |
2025.10 | - | - | 0.29 | - | |
2025.10 | - | - | 0.325 | - | |
2025.10 | - | - | 0.182 | - | |
2025.10 | - | - | 0.278 | - | |
2025.10 | - | - | 0.319 | - | |
2025.11 | - | - | 33 | - | |
2025.11 | - | - | 31.4 | - | |
2025.11 | - | - | 34.2 | - |