CodeContest
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Coding | CodeContest | Accuracy37.9 | 45 | |
| Code Generation | CodeContest | Pass@129.1 | 22 | |
| Code Generation | CodeContest Hard | PR73.8 | 21 | |
| Code Generation | CodeContest Easy | PR64.62 | 21 | |
| Code Generation | CodeContest (Advanced) | Pass Rate50.4 | 11 | |
| Code Generation | CodeContest (Basic) | Pass Rate49.99 | 11 | |
| Code Generation | CodeContest Overall | PR27.97 | 9 | |
| Code Generation | CodeContest | Pass@535.2 | 6 | |
| Code Generation | CodeContest | Pass@110.77 | 3 |
Showing 9 of 9 rows