Plug-and-Play image restoration with Stochastic deNOising REgularization
About
Plug-and-Play (PnP) algorithms are a class of iterative algorithms that address image inverse problems by combining a physical model and a deep neural network for regularization. Even if they produce impressive image restoration results, these algorithms rely on a non-standard use of a denoiser on images that are less and less noisy along the iterations, which contrasts with recent algorithms based on Diffusion Models (DM), where the denoiser is applied only on re-noised images. We propose a new PnP framework, called Stochastic deNOising REgularization (SNORE), which applies the denoiser only on images with noise of the adequate level. It is based on an explicit stochastic regularization, which leads to a stochastic gradient descent algorithm to solve ill-posed inverse problems. A convergence analysis of this algorithm and its annealing extension is provided. Experimentally, we prove that SNORE is competitive with respect to state-of-the-art methods on deblurring and inpainting tasks, both quantitatively and qualitatively.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Image Inpainting | FFHQ (test) | LPIPS0.25 | 97 | |
| Super-Resolution | FFHQ (test) | SSIM83.7 | 32 | |
| Image Deblurring | CBSD10 | PSNR29.92 | 18 | |
| Accelerated MRI | fastMRI (test) | PSNR27.41 | 14 | |
| Sparse-View CT Reconstruction | Lymph Node 20 views | PSNR38.46 | 7 | |
| Sparse-View CT Reconstruction | Lymph Node 30 views | PSNR40.27 | 7 | |
| Sparse-View CT Reconstruction | Lymph Node 50 views | PSNR42.23 | 7 | |
| Sparse-View CT Reconstruction | CQ500 20 views | PSNR36.58 | 7 | |
| Sparse-View CT Reconstruction | CQ500 40 views | PSNR41.71 | 7 | |
| Sparse-View CT Reconstruction | Lymph Node 40 views | PSNR41.55 | 7 |