64K scenario
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Inference Throughput | 64K scenario | Prefill Throughput (tok/s)8,191.3 | 10 |
Showing 1 of 1 rows
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Inference Throughput | 64K scenario | Prefill Throughput (tok/s)8,191.3 | 10 |