Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Non-Vacuous Certification of Transport MCMC via Oscillation-Controlled Normalizing Flows

About

Transport MCMC trains a normalizing flow to precondition Metropolis--Hastings proposals, achieving high empirical efficiency on challenging posteriors; yet no prior work produces a numerically non-vacuous, rigorous spectral-gap bound for such samplers. We establish the first such bounds. For independence MH on the banana family we certify (\gamma^\ast = 0.828) at (D = 2) (covering in the original space) and (\gamma^\ast \ge 7.6\times 10^{-4}) at (D = 5) (covering in an analytically unwarped Gaussian space with a grid-certified gradient bound under the stated numerical Lipschitz certification), both rigorous at 95% confidence. The framework rests on three pillars: (i) spectral normalization with reduced scale clips constrains the flow Lipschitz constant from (10^{47}) to (10^4); (ii) a coverage-based empirical oscillation bound replaces the vacuous analytical bound with a data-dependent certificate; and (iii) oscillation-regularised training cuts the empirical oscillation by 60--90% at no cost to density fit, extending practical certificates through (D = 20) ((\gamma^\ast \ge 1.7\times 10^{-4})). Tests on four further targets (Gaussian mixture, shear-building, Neal's funnel, Bayesian logistic regression) identify three precise barriers: boundary curvature, target stiffness, and tail-coverage mismatch. An affine-vs-spline comparison shows that simpler architectures yield tighter certificates at identical NLL, inverting the usual expressiveness hierarchy.

Jun Hu• 2026

Related benchmarks

TaskDatasetResultRank
Spectral gap boundingBanana
R6.66
8
MCMC certificationBanana
Gamma*7.6
4
Spectral gap boundingGMM
R Value6.26
2
Transport MCMCGMM (val)
NLL (val)7.86
2
Transport MCMCFunnel (val)
NLL (val)30.25
2
Transport MCMCBayes. LR (val)
NLL (val)28.64
2
Spectral gap boundingshear8
R2.08
1
Spectral gap boundingFunnel
R299
1
Spectral gap boundingBayes. LR
R11.9
1
Showing 9 of 9 rows

Other info

Follow for update