Code Generation on HumanEval (Acceptance Length and Speedup)
7.07Average Acceptance Length
BlockPilot
Updated 18d ago
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
2026.06 | 7.07 | 5.21 | - | |
2026.06 | 6.77 | 4.46 | - | |
2026.06 | 6.76 | 4.98 | - | |
2026.06 | 6.51 | 4.28 | - | |
2026.05 | 6.47 | 4.68 | - | |
2026.06 | 6.45 | 4.74 | - | |
2026.06 | 6.32 | 4.66 | - | |
2026.06 | 6.3 | 4.65 | - | |
2026.06 | 5.87 | 4.32 | - | |
2026.06 | 5.68 | 4.19 | - | |
2026.07 | 5.64 | - | - | |
2026.05 | 5.55 | 4.26 | - | |
2026.07 | 5.52 | - | - | |
2026.07 | 5.43 | - | - | |
2026.07 | 5.38 | - | - | |
2026.07 | 5.37 | - | - | |
2026.06 | 5.19 | 3.82 | - | |
2026.06 | 5.11 | 3.77 | - | |
2026.07 | 4.95 | - | - | |
2026.06 | 4.84 | 3.19 | - | |
2026.07 | 4.74 | - | - | |
2026.07 | 4.64 | - | - | |
2026.07 | 4.59 | - | - | |
2026.06 | 4.58 | 3.37 | - | |
2026.06 | 4.41 | 3.26 | - | |
2026.07 | 4.33 | - | - | |
2026.07 | 4.16 | - | - | |
2026.07 | 4.14 | - | - | |
2026.06 | 3.89 | 2.56 | - | |
2026.06 | 3.76 | 2.76 | - | |
2026.05 | 3.74 | 2.52 | - | |
2026.06 | 3.33 | 2.45 | - | |
2026.06 | 3.22 | 2.12 | - | |
2026.06 | 3.17 | 1.89 | - | |
2026.06 | 3.11 | 2.29 | - | |
2026.06 | 3.05 | 1.84 | - | |
2026.06 | 3.05 | 1.75 | - | |
2026.06 | 3.05 | 2.25 | - | |
2026.06 | 3.01 | 1.74 | - | |
2026.05 | 2.95 | 2.52 | - | |
2026.05 | 2.49 | 2.09 | - | |
2026.06 | - | 6.05 | 9.07 | |
2026.06 | - | 6.35 | 9.39 |