LLM Inference Service Benchmark
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| LLM Inference Performance | LLM Inference Service Benchmark | Max Concurrency256 | 8 |
Showing 1 of 1 rows
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| LLM Inference Performance | LLM Inference Service Benchmark | Max Concurrency256 | 8 |