Code Generation on HumanEval compile (L3)
14.71Pass@1
ShieldedCode
Updated 1mo ago
Evaluation Results
| Method | Links | ||
|---|---|---|---|
2026.01 | 14.71 | 22.83 | |
2026.01 | 11.89 | 18.99 | |
2026.01 | 6.17 | 8.9 | |
2026.01 | 5.39 | 7 | |
2026.01 | 5.32 | 6.2 | |
2026.01 | 4.89 | 6.06 | |
2026.01 | 4.29 | 4.41 | |
2026.01 | 2.79 | 4.56 |