LLM Generation Throughput
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| End-to-end generation | LLM Generation Throughput | Throughput (tokens/s)751 | 10 |
Showing 1 of 1 rows
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| End-to-end generation | LLM Generation Throughput | Throughput (tokens/s)751 | 10 |