Our new X account is live! Follow @wizwand_team for updates
Home
/
Benchmarks
Training Stability Analysis on Mixtral 8x1B pre-training
Loading...
0
Num Spikes
AdaGC
-2.08
11.96
26
40.04
Feb 16, 2025
Num Spikes
Spike Score (%)
Updated 4d ago
Evaluation Results
Method
Method
Links
Num Spikes
Spike Score (%)
AdaGC
Total Steps=36K
2025.02
0
0
GlobalGC
Total Steps=36K
2025.02
52
1.44
Feedback
Search any
task
Search any
task
