Synthetic Generation Workload
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Generation throughput | Synthetic Generation Workload 512 prompt + 1024 generation tokens | Throughput (tokens/s)52.1 | 8 | |
| Generation throughput | Synthetic Generation Workload 512 prompt + 512 generation tokens | Throughput (tokens/s)51.7 | 8 | |
| Generation throughput | Synthetic Generation Workload 512 prompt + 32 generation tokens | Throughput (tokens/s)35.1 | 8 |
Showing 3 of 3 rows