Code Benchmarks
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Code Generation | Code Benchmarks LCBv6 & MBPP+ | LCBv6 Score32.8 | 19 | |
| Code Reasoning | Code Benchmarks HumanEval MBPP | HumanEval72.29 | 18 | |
| Code Generation | Code Benchmarks (HumanEval, MBPP) | HumanEval Score30.1 | 17 | |
| Coding | Code Benchmarks Aggregate | Score37.5 | 12 | |
| Code Generation | Code Benchmarks Total | Avg@826.4 | 4 | |
| Code Generation | Code Benchmarks HumanEval, HumanEval+, MBPP, MBPP+ (test) | HumanEval Score55.5 | 3 | |
| Code Generation | Code Benchmarks (test) | HumanEval34.1 | 3 |
Showing 7 of 7 rows