Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Convergence of Kinetic Langevin Monte Carlo on Lie groups

About

Explicit, momentum-based dynamics for optimizing functions defined on Lie groups was recently constructed, based on techniques such as variational optimization and left trivialization. We appropriately add tractable noise to the optimization dynamics to turn it into a sampling dynamics, leveraging the advantageous feature that the trivialized momentum variable is Euclidean despite that the potential function lives on a manifold. We then propose a Lie-group MCMC sampler, by delicately discretizing the resulting kinetic-Langevin-type sampling dynamics. The Lie group structure is exactly preserved by this discretization. Exponential convergence with explicit convergence rate for both the continuous dynamics and the discrete sampler are then proved under $W_2$ distance. Only compactness of the Lie group and geodesically $L$-smoothness of the potential function are needed. To the best of our knowledge, this is the first convergence result for kinetic Langevin on curved spaces, and also the first quantitative result that requires no convexity or, at least not explicitly, any common relaxation such as isoperimetry.

Lingkai Kong, Molei Tao• 2024

Related benchmarks

TaskDatasetResultRank
PDE solving1d Burgers' equation (test)
Relative Error0.739
85
Image ClassificationMNIST PGL(3, R) (test)
Accuracy93.75
20
Image ClassificationMNIST Aff(2, R) (test)
Accuracy74.72
12
Image ClassificationMNIST Aff(2, R) 2D Affine (test)
Accuracy74.72
12
PDE solving1D Heat Eq. (test)
Relative L2 Error0.565
6
PDE solving1D Heat Eq. Data Aug. (test)
Relative Test L2 Error0.247
6
Showing 6 of 6 rows

Other info

Follow for update