Llama-3.1-8B
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Decoding Latency | Llama-3.1-8B 16k sequence length v1 (inference) | Decoding latency (s)0.024 | 8 |
Showing 1 of 1 rows
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Decoding Latency | Llama-3.1-8B 16k sequence length v1 (inference) | Decoding latency (s)0.024 | 8 |