Code Generation on HumanEval (M, Speedup)
16.47Functional Score M
DOUBLE
Updated 4d ago
Evaluation Results
| Method | Links | ||
|---|---|---|---|
2026.01 | 16.47 | 4.45 | |
2026.01 | 14.51 | 3.49 | |
2026.01 | 14.35 | 5.33 | |
2026.01 | 12.65 | 1.65 | |
2026.01 | 10.69 | 4.39 | |
2026.01 | 10.09 | 2.84 | |
2026.01 | 8.65 | 3.42 | |
2026.01 | 7.78 | 2.35 | |
2026.01 | 7.24 | 3.09 | |
2026.01 | 7.24 | 1.38 | |
2026.01 | 6.51 | 4.56 | |
2026.01 | 6.38 | 3.15 | |
2026.01 | 5.42 | 2.58 | |
2026.01 | 5.4 | 3.53 | |
2026.01 | 5.09 | 2.15 | |
2026.01 | 5.08 | 2.08 | |
2026.01 | 4.27 | 1.53 | |
2026.01 | 3.37 | 1.26 | |
2026.01 | 2.99 | 1.91 | |
2026.01 | 2.83 | 2.14 | |
2026.01 | 2.83 | 2.27 | |
2026.01 | 2.43 | 2.02 | |
2026.01 | 2.34 | 1.75 | |
2026.01 | 1.86 | 1.68 | |
2026.01 | 1.86 | 1.58 | |
2026.01 | 1.76 | 1.58 | |
2026.01 | 1.66 | 1.53 | |
2026.01 | 1.52 | 1.38 | |
2026.01 | 1.46 | 1.16 |