HumanEval and MBPP
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Code Generation | HumanEval and MBPP | Overall Average Score85.6 | 37 | |
| Code Generation | HumanEval and MBPP EvalPlus | HumanEval+ Pass@k70.1 | 29 | |
| Code-writing | HumanEval & MBPP EvalPlus (test) | HumanEval Pass Rate39.02 | 4 |
Showing 3 of 3 rows