Decoding Throughput
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Text Generation | Decoding Throughput | Decoding Throughput (tokens/s)320 | 16 |
Showing 1 of 1 rows
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Text Generation | Decoding Throughput | Decoding Throughput (tokens/s)320 | 16 |