Code Generation on HumanEval compile (L1)
0.1847Pass@1
ShieldedCode
Updated 1mo ago
Evaluation Results
| Method | Links | ||
|---|---|---|---|
2026.01 | 0.1847 | 0.2794 | |
2026.01 | 0.1743 | 0.2518 | |
2026.01 | 0.0689 | 0.1065 | |
2026.01 | 0.0571 | 0.0795 | |
2026.01 | 0.0538 | 0.0689 | |
2026.01 | 0.0512 | 0.0728 | |
2026.01 | 0.0491 | 0.0473 | |
2026.01 | 0.0326 | 0.0534 |