LMSys-Chat and ShareGPT traces
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| End-to-End Inference | LMSys-Chat-1M and ShareGPT traces | p99 TTFT (ms)74.46 | 18 |
Showing 1 of 1 rows
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| End-to-End Inference | LMSys-Chat-1M and ShareGPT traces | p99 TTFT (ms)74.46 | 18 |