Functional Coding on HumanEval (pass@k)
14.3Pass@1
Gumbel
Updated 21d ago
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
2026.05 | 14.3 | 20.5 | 25.6 | |
2026.05 | 14 | 20.7 | 28.1 | |
2026.05 | 13.8 | 22 | 27.5 | |
2026.05 | 13.7 | 22.7 | 25.3 | |
2026.05 | 13.1 | 18.9 | 27.8 | |
2026.05 | 11.6 | 19.5 | 23.2 |
Gumbel
| Method | Links | |||
|---|---|---|---|---|
2026.05 | 14.3 | 20.5 | 25.6 | |
2026.05 | 14 | 20.7 | 28.1 | |
2026.05 | 13.8 | 22 | 27.5 | |
2026.05 | 13.7 | 22.7 | 25.3 | |
2026.05 | 13.1 | 18.9 | 27.8 | |
2026.05 | 11.6 | 19.5 | 23.2 |