Sequence Bucket
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Language Model Inference | Sequence Bucket Ultra-long | Latency (ms)77.97 | 3 | |
| Language Model Inference | Sequence Bucket Long | Latency (ms)69.58 | 3 | |
| Language Model Inference | Sequence Bucket Medium | Latency (ms)52.88 | 3 | |
| Language Model Inference | Sequence Bucket Short | Latency (ms)39.26 | 3 |
Showing 4 of 4 rows