Hard Corpus
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Code Generation | Hard Corpus 192 problems 4 | Correctness (pass@1)83.3 | 12 | |
| Code Generation | Hard Corpus 4 (192 problems) | S-opt75.5 | 4 |
Showing 2 of 2 rows
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Code Generation | Hard Corpus 192 problems 4 | Correctness (pass@1)83.3 | 12 | |
| Code Generation | Hard Corpus 4 (192 problems) | S-opt75.5 | 4 |