MBPP+
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Unit test generation | MBPP+ (test) | Error Rate0.53 | 7 | |
| Code Generation | MBPP+ full latest | TPF670 | 3 | |
| Code Generation | MBPP+ 0-shot | Accuracy79.36 | 3 |
Showing 3 of 3 rows
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Unit test generation | MBPP+ (test) | Error Rate0.53 | 7 | |
| Code Generation | MBPP+ full latest | TPF670 | 3 | |
| Code Generation | MBPP+ 0-shot | Accuracy79.36 | 3 |