LIVECODE
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Coding | LiveCode | LiveCode Score41.2 | 22 | |
| Code Generation | LiveCode | Pass@16.4 | 10 | |
| Code Generation | LIVECODE (held-out) | DBS25.7 | 9 |
Showing 3 of 3 rows
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Coding | LiveCode | LiveCode Score41.2 | 22 | |
| Code Generation | LiveCode | Pass@16.4 | 10 | |
| Code Generation | LIVECODE (held-out) | DBS25.7 | 9 |