LIVECODE
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Coding | LiveCode (test) | Score36.8 | 32 | |
| Coding | LiveCode | LiveCode Score41.2 | 31 | |
| Code | LiveCode | Accuracy83.6 | 30 | |
| Code generation | LiveCode | Acceptance Length (τ)2.975 | 16 | |
| Code Generation | LiveCode | Pass@142.8 | 15 | |
| Code Generation | LIVECODE (held-out) | DBS25.7 | 9 | |
| Code Generation | LiveCode (test) | Accuracy67.8 | 8 |
Showing 7 of 7 rows