Decode Phase
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Large Language Model Inference | Decode Phase BS=1 | Latency (s)0.152 | 18 |
Showing 1 of 1 rows
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Large Language Model Inference | Decode Phase BS=1 | Latency (s)0.152 | 18 |