vLLM Throughput
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Throughput Benchmarking | vLLM Throughput 1,000 input / 1,000 output tokens | Throughput (req/s)2.42 | 3 |
Showing 1 of 1 rows
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Throughput Benchmarking | vLLM Throughput 1,000 input / 1,000 output tokens | Throughput (req/s)2.42 | 3 |