Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Self-Calibrated Variance-Stabilizing Transformations for Real-World Image Denoising

About

Supervised deep learning has become the method of choice for image denoising. It involves the training of neural networks on large datasets composed of pairs of noisy and clean images. However, the necessity of training data that are specific to the targeted application constrains the widespread use of denoising networks. Recently, several approaches have been developed to overcome this difficulty by whether artificially generating realistic clean/noisy image pairs, or training exclusively on noisy images. In this paper, we show that, contrary to popular belief, denoising networks specialized in the removal of Gaussian noise can be efficiently leveraged in favor of real-world image denoising, even without additional training. For this to happen, an appropriate variance-stabilizing transform (VST) has to be applied beforehand. We propose an algorithm termed Noise2VST for the learning of such a model-free VST. Our approach requires only the input noisy image and an off-the-shelf Gaussian denoiser. We demonstrate through extensive experiments the efficiency and superiority of Noise2VST in comparison to existing methods trained in the absence of specific clean/noisy pairs.

S\'ebastien Herbreteau, Michael Unser• 2024

Related benchmarks

TaskDatasetResultRank
Super-ResolutionUrban100
PSNR22.67
652
Image DenoisingUrban100
PSNR33.58
308
Super-ResolutionUrban100 (test)
PSNR22.07
220
Color Image DenoisingKodak24
PSNR34.64
174
Color Image DenoisingCBSD68
PSNR33.71
140
Color Image DenoisingMcMaster
PSNR33.48
111
Image DenoisingPolyU
PSNR36.6
66
Super-ResolutionCBSD68
PSNR (CBSD68)24.94
49
Super-ResolutionKodak24
PSNR25.73
49
Image DenoisingHighISO
PSNR35.99
48
Showing 10 of 29 rows

Other info

Follow for update