LCB
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Code Generation | LCB v6 (val) | Accuracy (%)78 | 13 | |
| Code Generation | LCB v5 | pass@149.5 | 11 | |
| Code Generation | LCB 2408-2505 | Pass@174.6 | 11 | |
| Code | LCB v6 | Score87.7 | 11 | |
| Code Generation | LCB (test) | Accuracy21.69 | 10 | |
| Code Generation | LCB v5 | Score37.63 | 9 | |
| Reasoning | LCB | Score59.58 | 9 | |
| Code Generation | LCB-IO | Pass@181.7 | 8 | |
| Code Reasoning | LCB | pass@162.46 | 8 | |
| Code Generation | LCB v6 | Pass@143.9 | 7 | |
| Code | LCB Pro Med 25Q2 | pass@110.5 | 7 | |
| Code | LCB 08/24-02/25 v5 | pass@177.5 | 7 | |
| Code Generation | LCB V6 | Throughput (Req/s)31.42 | 6 | |
| Reasoning | LCB v5 | Pass@142.1 | 6 | |
| Code Generation | LCB v6 | Accuracy42.18 | 5 | |
| Code Generation | LCB v5 (evaluation) | Pass@119.93 | 5 | |
| Code Generation | LCB | Accuracy13.4 | 4 | |
| Code Generation | LCB v6 | Accuracy48.8 | 4 | |
| Coding | LCB | Accuracy2.8 | 3 | |
| Coding reasoning | LCB | Avg@453.4 | 3 | |
| Code Generation | LCB | Throughput (tok/s)569 | 2 |
Showing 21 of 21 rows