Code Generation on HumanEval (Accuracy, Token Efficiency, and Runtime)
48.2Acc
Fixed-Length Denoising
Updated 3mo ago
Evaluation Results
| Method | Links | |||||
|---|---|---|---|---|---|---|
2026.01 | 48.2 | 691.1 | 2,048 | 33.8 | 16,046 | |
2026.01 | 45.1 | 462 | 512 | 90.2 | 1,474 | |
2026.01 | 45.1 | 631.1 | 1,024 | 61.6 | 4,569 | |
2026.01 | 44.5 | 494.7 | 813 | 64.8 | 1,283 | |
2026.01 | 43.9 | 643.1 | 769.9 | 83.5 | 593 | |
2026.01 | 43.3 | 570.4 | 654 | 88.4 | 580 | |
2026.01 | 36.6 | 247.3 | 256 | 96.6 | 543 | |
2026.01 | 26.2 | 125 | 128 | 97.7 | 230 | |
2026.01 | 17.1 | 59.6 | 64 | 93.2 | 111 |