Multi-LLM Serving Workload
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| System Performance Evaluation | Multi-LLM Serving Workload | TTFT (ms)96.4 | 6 |
Showing 1 of 1 rows
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| System Performance Evaluation | Multi-LLM Serving Workload | TTFT (ms)96.4 | 6 |