HEval
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Code generation | HEval | Pass@168.29 | 21 | |
| Coding | HEval | Accuracy84.8 | 20 | |
| Instruction-following | HEval | PASS@146.12 | 12 | |
| Coding | HEval+ | Accuracy75 | 12 |
Showing 4 of 4 rows
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Code generation | HEval | Pass@168.29 | 21 | |
| Coding | HEval | Accuracy84.8 | 20 | |
| Instruction-following | HEval | PASS@146.12 | 12 | |
| Coding | HEval+ | Accuracy75 | 12 |