Code Generation on HumanEval compile (L0)
26.95Pass@1
ShieldedCode
Updated 1mo ago
Evaluation Results
| Method | Links | ||
|---|---|---|---|
2026.01 | 26.95 | 35.68 | |
2026.01 | 22.58 | 31.47 | |
2026.01 | 10.28 | 14.23 | |
2026.01 | 7.84 | 9.21 | |
2026.01 | 6.89 | 10.18 | |
2026.01 | 6.42 | 7.64 | |
2026.01 | 5.78 | 9.45 | |
2026.01 | 5.31 | 7.12 |