Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Non-equilibrium Annealed Adjoint Sampler

About

Recently, there has been significant progress in learning-based diffusion samplers, which aim to sample from a given unnormalized density. Many of these approaches formulate the sampling task as a stochastic optimal control (SOC) problem using a canonical uninformative reference process, which limits their ability to efficiently guide trajectories toward the target distribution. In this work, we propose the Non-Equilibrium Annealed Adjoint Sampler (NAAS), a novel SOC-based diffusion framework that employs annealed reference dynamics as a non-stationary base SDE. This annealing structure provides a natural progression toward the target distribution and generates informative reference trajectories, thereby enhancing the stability and efficiency of learning the control. Owing to our SOC formulation, our framework can incorporate a variety of SOC solvers, thereby offering high flexibility in algorithmic design. As one instantiation, we employ a lean adjoint system inspired by adjoint matching, enabling efficient and scalable training. We demonstrate the effectiveness of NAAS across a range of tasks, including sampling from classical energy landscapes and molecular Boltzmann distributions.

Jaemoo Choi, Yongxin Chen, Molei Tao, Guan-Horng Liu• 2025

Related benchmarks

TaskDatasetResultRank
Target Distribution SamplingFunnel 10D
Sinkhorn Distance132.3
29
Toy target distribution samplingGMM40 d = 50
W2 (Entropy Regulated, eps=0.05)496.5
18
Learning Continuous Target DistributionsMoS d = 50
Sinkhorn Cost394.6
11
Target Distribution SamplingMany-Well 5D
Sinkhorn Distance0.1
11
Showing 4 of 4 rows

Other info

Follow for update