Our new X account is live! Follow @wizwand_team for updates
Home
/
Benchmarks
Training Stability Analysis on Llama-2 7B pre-training
Loading...
0
Number of Spikes
AdaGC
-0.36
2.07
4.5
6.93
Feb 16, 2025
Number of Spikes
Spike Score
Updated 4d ago
Evaluation Results
Method
Method
Links
Number of Spikes
Spike Score
AdaGC
Total Steps=9K
2025.02
0
0
AdaGC
Total Steps=9K
2025.02
0
0
WeSaR-GlobalGC
Total Steps=9K
2025.02
1
1.11
SPAM
Total Steps=9K
2025.02
3
3.33
GlobalGC
Total Steps=9K
2025.02
3
3.33
Clippy
Total Steps=9K
2025.02
3
3.33
ScaledEmbed-GlobalGC
Total Steps=9K
2025.02
8
8.89
AGC
Total Steps=9K
2025.02
8
8.89
ClipByValue
Total Steps=9K
2025.02
9
10
Feedback
Search any
task
Search any
task