Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Stochastic Optimization Convergence on Theoretical Analysis
Loading...
4
Convergence Rate Bound
Normalized SGD
-1.2
0.15
1.5
2.85
Mar 2, 2026
Mar 13, 2026
Mar 24, 2026
Apr 4, 2026
Apr 15, 2026
Apr 26, 2026
May 8, 2026
Convergence Rate Bound
Updated 23d ago
Evaluation Results
Method
Method
Links
Convergence Rate Bound
Normalized SGD
Class=Stochastic LMO,...
2026.05
4
signSGD
Class=Stochastic LMO,...
2026.05
4
Signum
Class=Stochastic LMO,...
2026.05
4
Lion
Class=Stochastic LMO,...
2026.05
4
Muon
Class=Stochastic LMO,...
2026.05
4
NIGT
Class=LMO-IGT, Gradien...
2026.05
3.5
Lion-IGT
Class=LMO-IGT, Gradien...
2026.05
3.5
Muon-IGT
Class=LMO-IGT, Gradien...
2026.05
3.5
Lion-VR
Class=LMO-VR, Gradient...
2026.05
3
MARS-Shampoo
Class=LMO-VR, Gradient...
2026.05
3
Muon-VR
Class=LMO-VR, Gradient...
2026.05
3
Qian et al.
Learning rate regime (...
2026.05
3
Poisson-Moreau Drift
Learning rate regime (...
2026.05
2
Poisson-Moreau Drift
Learning rate regime (...
2026.05
2
D-PSGD
Communication=none, As...
2026.03
1
CHOCO-SGD
Communication=A, Assum...
2026.03
1
SQuARM-SGD
Communication=A, Assum...
2026.03
1
DFedSAM
Communication=B, Assum...
2026.03
1
EL
Communication=B, Assum...
2026.03
1
DCD-PSGD
Communication=A, Assum...
2026.03
1
BEER
Communication=A, Assum...
2026.03
1
Qian et al.
Learning rate regime (...
2026.05
1
Poisson-Moreau Drift
Learning rate regime (...
2026.05
-1
Feedback
Search any
task
Search any
task