Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Provable Probabilistic Imaging using Score-Based Generative Priors

About

Estimating high-quality images while also quantifying their uncertainty are two desired features in an image reconstruction algorithm for solving ill-posed inverse problems. In this paper, we propose plug-and-play Monte Carlo (PMC) as a principled framework for characterizing the space of possible solutions to a general inverse problem. PMC is able to incorporate expressive score-based generative priors for high-quality image reconstruction while also performing uncertainty quantification via posterior sampling. In particular, we develop two PMC algorithms that can be viewed as the sampling analogues of the traditional plug-and-play priors (PnP) and regularization by denoising (RED) algorithms. To improve the sampling efficiency, we introduce weighted annealing into these PMC algorithms, further developing two additional annealed PMC algorithms (APMC). We establish a theoretical analysis for characterizing the convergence behavior of PMC algorithms. Our analysis provides non-asymptotic stationarity guarantees in terms of the Fisher information, fully compatible with the joint presence of weighted annealing, potentially non-log-concave likelihoods, and imperfect score networks. We demonstrate the performance of the PMC algorithms on multiple representative inverse problems with both linear and nonlinear forward models. Experimental results show that PMC significantly improves reconstruction quality and enables high-fidelity uncertainty quantification.

Yu Sun, Zihui Wu, Yifan Chen, Berthy T. Feng, Katherine L. Bouman• 2023

Related benchmarks

TaskDatasetResultRank
Gaussian DeblurringFFHQ
PSNR20.172
34
InpaintingFFHQ
LPIPS0.263
32
Motion DeblurringImageNet
SSIM0.48
27
Phase RetrievalFFHQ
PSNR10.421
26
Super-ResolutionImageNet
PSNR22.534
25
Phase RetrievalImageNet
PSNR8.636
19
Motion DeblurFFHQ
PSNR19.48
17
SuperresolutionFFHQ
PSNR23.774
10
Gaussian BlurImageNet
PSNR24.103
8
Nonlinear DeblurringFFHQ 100 images
PSNR21.102
5
Showing 10 of 13 rows

Other info

Follow for update