GPUMode MLA Decode
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| MLA Decode | GPUMode MLA Decode AMD MI300X Instance 3 | Decode Latency (µs)1,668.7 | 7 | |
| MLA Decode | GPUMode MLA Decode AMD MI300X Instance 2 | Runtime (µs)1,688.6 | 7 | |
| MLA Decode | GPUMode MLA Decode AMD MI300X Instance 1 | Decode Latency (µs)1,653.8 | 7 |
Showing 3 of 3 rows