Code Generation on HumanEval compile (L2)
19.23Pass@1
ShieldedCode
Updated 1mo ago
Evaluation Results
| Method | Links | ||
|---|---|---|---|
2026.01 | 19.23 | 29.71 | |
2026.01 | 15.26 | 22.36 | |
2026.01 | 7.94 | 12.18 | |
2026.01 | 6.23 | 6.82 | |
2026.01 | 6.08 | 5.94 | |
2026.01 | 5.97 | 7.28 | |
2026.01 | 5.19 | 7.89 | |
2026.01 | 4.87 | 6.74 |