LLM Prefix-based Inference
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Time To First Token (TTFT) | LLM Prefix-based Inference | TTFT (ms)51 | 12 |
Showing 1 of 1 rows
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Time To First Token (TTFT) | LLM Prefix-based Inference | TTFT (ms)51 | 12 |