High-load generation workload
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| LLM Serving | High-load generation workload w/ NVLink | TTFT (ms)443 | 27 | |
| LLM Serving | High-load generation workload w/o NVLink | Time To First Token (ms)878 | 27 |
Showing 2 of 2 rows