GPU timing experiment
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Inference Performance Evaluation | GPU timing experiment 2K-8K context lengths | TTFT116 | 16 |
Showing 1 of 1 rows
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Inference Performance Evaluation | GPU timing experiment 2K-8K context lengths | TTFT116 | 16 |