ClassEval
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Code Generation | ClassEval | Spd4.28 | 33 | |
| Code Generation and Watermark Detection | ClassEval (test) | Pass@521 | 14 | |
| Code Generation | ClassEval | Pass@1 (Class-level)27 | 9 | |
| Class-level Code Translation | ClassEval-T | Functional Correctness28.4 | 4 |
Showing 4 of 4 rows