CodeContest
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Code Generation | CodeContest Hard | PR73.8 | 21 | |
| Code Generation | CodeContest Easy | PR64.62 | 21 | |
| Code Generation | CodeContest (Advanced) | Pass Rate50.4 | 11 | |
| Code Generation | CodeContest (Basic) | Pass Rate49.99 | 11 | |
| Code Generation | CodeContest | Pass@128.5 | 10 | |
| Code Generation | CodeContest Overall | PR27.97 | 9 | |
| Code Generation | CodeContest | Pass@535.2 | 6 | |
| Code Generation | CodeContest | Pass@110.77 | 3 |
Showing 8 of 8 rows