Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Principled Probabilistic Imaging using Diffusion Models as Plug-and-Play Priors

About

Diffusion models (DMs) have recently shown outstanding capabilities in modeling complex image distributions, making them expressive image priors for solving Bayesian inverse problems. However, most existing DM-based methods rely on approximations in the generative process to be generic to different inverse problems, leading to inaccurate sample distributions that deviate from the target posterior defined within the Bayesian framework. To harness the generative power of DMs while avoiding such approximations, we propose a Markov chain Monte Carlo algorithm that performs posterior sampling for general inverse problems by reducing it to sampling the posterior of a Gaussian denoising problem. Crucially, we leverage a general DM formulation as a unified interface that allows for rigorously solving the denoising problem with a range of state-of-the-art DMs. We demonstrate the effectiveness of the proposed method on six inverse problems (three linear and three nonlinear), including a real-world black hole imaging problem. Experimental results indicate that our proposed method offers more accurate reconstructions and posterior estimation compared to existing DM-based imaging inverse methods.

Zihui Wu, Yu Sun, Yifan Chen, Bingliang Zhang, Yisong Yue, Katherine L. Bouman• 2024

Related benchmarks

TaskDatasetResultRank
Gaussian DeblurringFFHQ
PSNR25.2
34
Gaussian DeblurringImageNet
SSIM0.63
32
Super-Resolution (4x)ImageNet
PSNR23.8
30
Motion DeblurringImageNet
SSIM0.6
27
Phase RetrievalFFHQ
PSNR18.1
26
MRI ReconstructionfastMRI Knee (test)
SSIM63.83
26
Inpaint (box)ImageNet
PSNR12.6
26
HDRFFHQ
PSNR21.4
25
Motion DeblurringFFHQ
PSNR24.7
22
HDRImageNet
PSNR22.1
21
Showing 10 of 55 rows

Other info

Follow for update