MBPP+
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Code Generation | MBPP+ Out-of-Domain (test) | Accuracy65.61 | 18 | |
| Unit test generation | MBPP+ (test) | Error Rate0.53 | 7 | |
| Code Generation | MBPP+ | Success Rate (avg@4)70.8 | 6 | |
| Code Generation | MBPP+ full latest | TPF670 | 3 | |
| Code Generation | MBPP+ 0-shot | Accuracy79.36 | 3 |
Showing 5 of 5 rows