Non-equilibrium Annealed Adjoint Sampler
About
Recently, there has been significant progress in learning-based diffusion samplers, which aim to sample from a given unnormalized density. Many of these approaches formulate the sampling task as a stochastic optimal control (SOC) problem using a canonical uninformative reference process, which limits their ability to efficiently guide trajectories toward the target distribution. In this work, we propose the Non-Equilibrium Annealed Adjoint Sampler (NAAS), a novel SOC-based diffusion framework that employs annealed reference dynamics as a non-stationary base SDE. This annealing structure provides a natural progression toward the target distribution and generates informative reference trajectories, thereby enhancing the stability and efficiency of learning the control. Owing to our SOC formulation, our framework can incorporate a variety of SOC solvers, thereby offering high flexibility in algorithmic design. As one instantiation, we employ a lean adjoint system inspired by adjoint matching, enabling efficient and scalable training. We demonstrate the effectiveness of NAAS across a range of tasks, including sampling from classical energy landscapes and molecular Boltzmann distributions.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Target Distribution Sampling | Funnel 10D | Sinkhorn Distance132.3 | 29 | |
| Toy target distribution sampling | GMM40 d = 50 | W2 (Entropy Regulated, eps=0.05)496.5 | 18 | |
| Learning Continuous Target Distributions | MoS d = 50 | Sinkhorn Cost394.6 | 11 | |
| Target Distribution Sampling | Many-Well 5D | Sinkhorn Distance0.1 | 11 |