LLM Prompt Length
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| LLM Prefill throughput | LLM Prompt Length 2048 (pp2048) | Prefill Throughput (tok/s)4,447 | 36 | |
| LLM Prefill throughput | LLM Prompt Length 1024 | Prefill Throughput (tok/s)4,748 | 36 |
Showing 2 of 2 rows