Coding on HumanEval (Throughput and Speedup)
3,070Throughput
SpecBundle
Updated 29d ago
Evaluation Results
| Method | Links | ||
|---|---|---|---|
2026.03 | 3,070 | 2.25 | |
2026.03 | 1,944.8 | 3.08 | |
| 1,556.5 | 2.46 | ||
2026.03 | 1,506 | 2.68 | |
2026.03 | 1,366.6 | 1 | |
2026.03 | 1,359 | 1.83 | |
| 1,282.8 | 2.29 | ||
2026.03 | 1,267.5 | 2.29 | |
2026.03 | 897.9 | 1.93 | |
| 889.9 | 1.61 | ||
2026.03 | 740.2 | 1 | |
2026.03 | 631.9 | 1 | |
2026.03 | 571.5 | 2.99 | |
2026.03 | 561 | 1 | |
2026.03 | 553.1 | 1 | |
| 480.3 | 2.52 | ||
2026.03 | 466.1 | 1 | |
2026.03 | 190.9 | 1 |