Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Gradient Step Denoiser for convergent Plug-and-Play

About

Plug-and-Play methods constitute a class of iterative algorithms for imaging problems where regularization is performed by an off-the-shelf denoiser. Although Plug-and-Play methods can lead to tremendous visual performance for various image problems, the few existing convergence guarantees are based on unrealistic (or suboptimal) hypotheses on the denoiser, or limited to strongly convex data terms. In this work, we propose a new type of Plug-and-Play methods, based on half-quadratic splitting, for which the denoiser is realized as a gradient descent step on a functional parameterized by a deep neural network. Exploiting convergence results for proximal gradient descent algorithms in the non-convex setting, we show that the proposed Plug-and-Play algorithm is a convergent iterative scheme that targets stationary points of an explicit global functional. Besides, experiments show that it is possible to learn such a deep denoiser while not compromising the performance in comparison to other state-of-the-art deep denoisers used in Plug-and-Play schemes. We apply our proximal gradient algorithm to various ill-posed inverse problems, e.g. deblurring, super-resolution and inpainting. For all these applications, numerical results empirically confirm the convergence results. Experiments also show that this new algorithm reaches state-of-the-art performance, both quantitatively and qualitatively.

Samuel Hurault, Arthur Leclaire, Nicolas Papadakis• 2021

Related benchmarks

TaskDatasetResultRank
InpaintingCelebA
PSNR22.97
49
Super-ResolutionCelebA (test)
PSNR31.33
41
Super-ResolutionAFHQ Cat (test)
LPIPS0.362
31
DenoisingAFHQ Cat (test)
PSNR32.58
30
DeblurringCelebA
PSNR33.65
28
Image DeblurringCelebA (test)
PSNR34.03
25
Random InpaintingAFHQ Cat (test)
PSNR29.42
24
Super-ResolutionCelebA--
24
DenoisingAFHQ Cat
PSNR32.26
18
Inference SpeedAverage per-image runtime
Average Runtime (sec)0.31
15
Showing 10 of 32 rows

Other info

Follow for update