serving scenario
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Text Generation | 64K 64K serving scenario Single H100 GPU | Throughput (K tok/s)0.8 | 5 |
Showing 1 of 1 rows
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Text Generation | 64K 64K serving scenario Single H100 GPU | Throughput (K tok/s)0.8 | 5 |