Code Generation on HumanEval (tau and Speedup)
8.22Speedup Factor
DFlash+DDTree
Updated 4d ago
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
2026.04 | 8.22 | 10.72 | - | |
2026.04 | 7.88 | 10.42 | - | |
2026.05 | 6.94 | 9.19 | - | |
2026.04 | 6.9 | 9.67 | - | |
2026.04 | 6.81 | 9.44 | - | |
2026.05 | 6.75 | 8.09 | - | |
2026.05 | 6.74 | 7.95 | - | |
2026.04 | 6.43 | 9.18 | - | |
2026.04 | 6.09 | 8.02 | - | |
2026.04 | 6.09 | 8.59 | - | |
2026.05 | 6.02 | 6.57 | - | |
2026.05 | 5.66 | 6.94 | - | |
2026.05 | 5.65 | 6.6 | - | |
2026.04 | 5.64 | 7.6 | - | |
2026.05 | 5.64 | 6.04 | - | |
2026.05 | 5.42 | 6.13 | - | |
2026.05 | 5.3 | 6.02 | - | |
2026.05 | 5.19 | 5.73 | - | |
2026.05 | 5.19 | 6.04 | - | |
2026.05 | 5.17 | 5.96 | - | |
2026.05 | 5.17 | 5.73 | - | |
2026.05 | 5.16 | 5.25 | - | |
2026.05 | 5.09 | 6.71 | - | |
2026.05 | 5.02 | 6.33 | - | |
2026.05 | 4.97 | 5.62 | - | |
2026.05 | 4.94 | 5.99 | - | |
2026.05 | 4.87 | 6.75 | - | |
2026.05 | 4.85 | 4.8408 | - | |
2026.04 | 4.84 | 6.61 | - | |
2026.04 | 4.81 | 6.62 | - | |
2026.05 | 4.77 | 5.51 | - | |
2026.05 | 4.75 | 6.68 | - | |
2026.05 | 4.71 | 5.19 | - | |
2026.05 | 4.53 | 5.84 | - | |
2026.05 | 4.47 | 5.05 | - | |
2026.05 | 4.46 | 5.64 | - | |
2026.05 | 4.4 | 5.13 | - | |
2026.05 | 4.38 | 5.33 | - | |
2026.04 | 4.34 | 5.97 | - | |
2026.05 | 4.29 | 5.69 | - | |
2026.05 | 4.24 | 4.0802 | - | |
2026.05 | 4.21 | 4.2009 | - | |
2026.05 | 4.17 | 4.77 | - | |
2026.05 | 4.14 | 7.23 | - | |
2026.05 | 4.12 | 4.66 | - | |
2026.05 | 4.05 | 6.99 | - | |
2026.05 | 4.02 | 5.66 | - | |
2026.04 | 4 | 5.48 | - | |
2026.05 | 3.95 | 5.33 | - | |
2026.05 | 3.77 | 5.03 | - | |
2026.05 | 3.65 | 3.5174 | - | |
2026.03 | 3.36 | 5.35 | - | |
2026.04 | 3.36 | 4.11 | - | |
2026.04 | 3.34 | 5.24 | - | |
2026.05 | 3.34 | 4.55 | - | |
2026.05 | 3.14 | 4.1547 | - | |
2026.03 | 3.1 | 4.79 | - | |
2026.03 | 3.08 | 4.75 | - | |
2026.03 | 3.05 | 4.7 | - | |
2026.04 | 2.99 | 5.02 | - | |
2026.04 | 2.97 | 3.63 | - | |
2026.05 | 2.89 | 2.876 | - | |
2026.04 | 2.84 | 3.37 | - | |
2026.04 | 2.79 | 3.4 | - | |
2026.05 | 2.7 | 2.6832 | - | |
2026.05 | 2.7 | 3.5949 | - | |
2026.05 | 2.61 | 3.4546 | - | |
2026.05 | 2.59 | 3.3703 | - | |
2026.04 | 2.53 | 3.06 | - | |
2026.05 | 2.53 | 2.5128 | - | |
2026.04 | 2.49 | 2.94 | - | |
2025.07 | 2.47 | - | 2.88 | |
2026.04 | 2.46 | 4.95 | - | |
2026.04 | 2.37 | 2.83 | - | |
2026.04 | 2.34 | 2.78 | - | |
2026.05 | 2.32 | 2.86 | - | |
2025.07 | 2.31 | - | 2.63 | |
2026.03 | 2.28 | 4.38 | - | |
2025.07 | 2.24 | - | 2.62 | |
2026.05 | 2.24 | 2.8979 | - | |
2026.05 | 2.19 | 2.9005 | - | |
2026.04 | 2.18 | 2.55 | - | |
2026.05 | 2.11 | 2.68 | - | |
2025.07 | 2.1 | - | 2.38 | |
2026.03 | 2 | 3.72 | - | |
2026.03 | 1.98 | 3.7 | - | |
2026.04 | 1.98 | 2.08 | - | |
2026.04 | 1.97 | 2.37 | - | |
2026.03 | 1.95 | 3.6 | - | |
2025.07 | 1.95 | - | 2.66 | |
2025.07 | 1.95 | - | 2.41 | |
2025.07 | 1.93 | - | 2.33 | |
2026.04 | 1.92 | 2.01 | - | |
2025.07 | 1.92 | - | 2.18 | |
2026.05 | 1.84 | 1.7984 | - | |
2026.05 | 1.81 | 1.767 | - | |
2025.07 | 1.8 | - | 2.56 | |
2025.07 | 1.8 | - | 2.27 | |
2025.07 | 1.77 | - | 1.98 | |
2025.07 | 1.76 | - | 2.33 |
Showing 100 of 147 rows