Image Restoration by Iterative Denoising and Backward Projections
About
Inverse problems appear in many applications, such as image deblurring and inpainting. The common approach to address them is to design a specific algorithm for each problem. The Plug-and-Play (P&P) framework, which has been recently introduced, allows solving general inverse problems by leveraging the impressive capabilities of existing denoising algorithms. While this fresh strategy has found many applications, a burdensome parameter tuning is often required in order to obtain high-quality results. In this work, we propose an alternative method for solving inverse problems using off-the-shelf denoisers, which requires less parameter tuning. First, we transform a typical cost function, composed of fidelity and prior terms, into a closely related, novel optimization problem. Then, we propose an efficient minimization scheme with a plug-and-play property, i.e., the prior term is handled solely by a denoising operation. Finally, we present an automatic tuning mechanism to set the method's parameters. We provide a theoretical analysis of the method, and empirically demonstrate its competitiveness with task-specific techniques and the P&P approach for image inpainting and deblurring.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Deblurring | BSD68 | PSNR30.15 | 31 | |
| Deblurring | BSD68 Scenario 3 | PSNR31.12 | 7 | |
| Image Deblurring | Standard Images Scenario 3 (test) | ISNR (cameraman)10.55 | 7 | |
| Deblurring | BSD68 Scenario 1 | PSNR31.17 | 7 | |
| Deblurring | BSD68 Scenario 2 | PSNR29.19 | 7 | |
| Deblurring | BSD68 Scenario 4 | PSNR29.13 | 7 | |
| Image Deblurring | Standard Images Scenario 1 (test) | ISNR (cameraman)9.08 | 7 | |
| Image Deblurring | Standard Test Images Scenario 2 | ISNR (Cameraman)7.28 | 7 | |
| Image Deblurring | Standard Test Images Scenario 4 | ISNR (Cameraman)4.25 | 7 | |
| Image Inpainting | cameraman 80% missing pixels, sigma_e = 0 (test) | PSNR24.86 | 5 |