CodeMMLU
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Code Understanding | CodeMMLU | Exact Match (EM)53.52 | 28 | |
| Coding Reasoning | CodeMMLU | Pass@482.8 | 6 |
Showing 2 of 2 rows
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Code Understanding | CodeMMLU | Exact Match (EM)53.52 | 28 | |
| Coding Reasoning | CodeMMLU | Pass@482.8 | 6 |