vLLM benchmark
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Language Model Inference | vLLM benchmark 1024 prompts | Latency (s)1.839 | 2 |
Showing 1 of 1 rows
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Language Model Inference | vLLM benchmark 1024 prompts | Latency (s)1.839 | 2 |