MoE LLMs
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Inference Efficiency | MoE LLMs DSV2-16B, QW3-30B, QW3-80B-I | Decode Speed (tokens/sec)12.46 | 9 |
Showing 1 of 1 rows
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Inference Efficiency | MoE LLMs DSV2-16B, QW3-30B, QW3-80B-I | Decode Speed (tokens/sec)12.46 | 9 |