LeetCode
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Code Generation | LeetCode Contest Benchmark | Easy Accuracy73.3 | 13 | |
| Code Generation | Leetcode-New | Pass Rate49.08 | 12 | |
| Code Generation | LeetCodeHard | Accuracy38.2 | 8 | |
| Unit test generation | LeetCode (test) | Error Rate (%)2.77 | 7 | |
| Code Generation | Leetcode-Guided | Pass Rate48.02 | 6 | |
| Code Generation | Leetcode Original | Pass Rate38.6 | 6 | |
| Code Generation | LeetCode Weekly Contests 484-488 | Pass Rate85 | 4 | |
| Software Engineering / Coding | Leetcode hard | Hard LeetCode Accuracy26 | 1 | |
| Software Engineering / Coding | Leetcode medium | Metric- | 0 | |
| Software Engineering / Coding | Leetcode easy | Metric- | 0 |
Showing 10 of 10 rows