Mixtral
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Training Efficiency | Mixtral-8x22b-G8T8 Fine-grained | MFU28.8 | 5 | |
| Training Efficiency | Mixtral-8x22B Coarse-grained | MFU49.3 | 5 | |
| Training Stability Analysis | Mixtral 8x1B pre-training | Num Spikes0 | 2 |
Showing 3 of 3 rows