HumanEval, MBPP
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Coding | HumanEval, MBPP | HumanEval Score50.2 | 35 | |
| Code Generation | HumanEval+, MBPP+ v1.0 (test) | HumanEval+ Accuracy88.41 | 20 |
Showing 2 of 2 rows
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Coding | HumanEval, MBPP | HumanEval Score50.2 | 35 | |
| Code Generation | HumanEval+, MBPP+ v1.0 (test) | HumanEval+ Accuracy88.41 | 20 |