Code Domain
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Code Generation | Code Domain HumanEval, HumanEval+, MBPP, MBPP+, Bigcode (test) | HumanEval48.2 | 18 | |
| Text-Based Optimization | Code Domain (test) | Accuracy89.89 | 5 |
Showing 2 of 2 rows
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Code Generation | Code Domain HumanEval, HumanEval+, MBPP, MBPP+, Bigcode (test) | HumanEval48.2 | 18 | |
| Text-Based Optimization | Code Domain (test) | Accuracy89.89 | 5 |