Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Generative Modeling from Black-box Corruptions via Self-Consistent Stochastic Interpolants

About

Transport-based methods have emerged as a leading paradigm for building generative models from large, clean datasets. However, in many scientific and engineering domains, clean data are often unavailable: instead, we only observe measurements corrupted through a noisy, ill-conditioned channel. A generative model for the original data thus requires solving an inverse problem at the level of distributions. In this work, we introduce a novel approach to this task based on Stochastic Interpolants: we iteratively update a transport map between corrupted and clean data samples using only access to the corrupted dataset as well as black box access to the corruption channel. Under appropriate conditions, this iterative procedure converges towards a self-consistent transport map that effectively inverts the corruption channel, thus enabling a generative model for the clean data. We refer to the resulting method as the self-consistent stochastic interpolant (SCSI). It (i) is computationally efficient compared to variational alternatives, (ii) highly flexible, handling arbitrary nonlinear forward models with only black-box access, and (iii) enjoys theoretical guarantees. We demonstrate superior performance on inverse problems in natural image processing and scientific reconstruction, and establish convergence guarantees of the scheme under appropriate assumptions.

Chirag Modi, Jiequn Han, Eric Vanden-Eijnden, Joan Bruna• 2025

Related benchmarks

TaskDatasetResultRank
Image ReconstructionCIFAR-10
LPIPS0.005
25
Generative ModelingCIFAR-10
FID5.16
7
Image RestorationCIFAR-10 Random masking (rho=0.5, sigma_n=0.1) (test)
LPIPS0.0065
3
Image RestorationCIFAR-10 with Gaussian blur (sigma_R=1.0, sigma_n=0.1) (test)
LPIPS0.0054
3
Image RestorationCIFAR-10 with Gaussian blur (sigma_R=1.0, sigma_n=0.25) (test)
LPIPS0.0149
3
Image RestorationCIFAR-10 with Motion blur (k=5, sigma_n=0.1) (test)
LPIPS0.0108
3
Image RestorationCIFAR-10 with Random masking (rho=0.5, sigma_n=10^-6) (test)
LPIPS0.005
3
Image RestorationCIFAR-10 with Motion blur (k=5, sigma_n=10^-6) (test)
LPIPS0.0069
3
Showing 8 of 8 rows

Other info

Follow for update