Program Synthesis on openai_humaneval (test)
15.52Pass@1
BLOOM-176B
Updated 4d ago
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
2022.11 | 15.52 | 32.2 | 55.45 | |
2022.11 | 13.55 | 26.26 | 47.01 | |
2022.11 | 12.06 | 26.53 | 48.44 | |
2022.11 | 0 | 0 | 0 |
BLOOM-176B
| Method | Links | |||
|---|---|---|---|---|
2022.11 | 15.52 | 32.2 | 55.45 | |
2022.11 | 13.55 | 26.26 | 47.01 | |
2022.11 | 12.06 | 26.53 | 48.44 | |
2022.11 | 0 | 0 | 0 |