LCB
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Code Generation | LCB 2408-2505 | Pass@174.6 | 11 | |
| Code Generation | LCB (test) | Accuracy21.69 | 10 | |
| Code Generation | LCB v5 | Score37.63 | 9 | |
| Reasoning | LCB | Score59.58 | 9 | |
| Code Reasoning | LCB | pass@162.46 | 8 | |
| Code | LCB Pro Med 25Q2 | pass@110.5 | 7 | |
| Code | LCB 08/24-02/25 v5 | pass@177.5 | 7 | |
| Code | LCB v6 | Score60 | 6 | |
| Code Generation | LCB v6 | Accuracy48.8 | 4 | |
| Coding reasoning | LCB | Avg@453.4 | 3 | |
| Code Generation | LCB | Throughput (tok/s)569 | 2 |
Showing 11 of 11 rows