Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Zero-Shot Noise2Noise: Efficient Image Denoising without any Data

About

Recently, self-supervised neural networks have shown excellent image denoising performance. However, current dataset free methods are either computationally expensive, require a noise model, or have inadequate image quality. In this work we show that a simple 2-layer network, without any training data or knowledge of the noise distribution, can enable high-quality image denoising at low computational cost. Our approach is motivated by Noise2Noise and Neighbor2Neighbor and works well for denoising pixel-wise independent noise. Our experiments on artificial, real-world camera, and microscope noise show that our method termed ZS-N2N (Zero Shot Noise2Noise) often outperforms existing dataset-free methods at a reduced cost, making it suitable for use cases with scarce data availability and limited computational resources. A demo of our implementation including our code and hyperparameters can be found in the following colab notebook: https://colab.research.google.com/drive/1i82nyizTdszyHkaHBuKPbWnTzao8HF9b

Youssef Mansour, Reinhard Heckel• 2023

Related benchmarks

TaskDatasetResultRank
Image DenoisingSIDD (val)
PSNR25.59
105
Image DenoisingSIDD Benchmark
PSNR30.19
61
Image DenoisingPolyU
PSNR35.99
56
Image DenoisingKodak (test)
PSNR31.02
42
Image DenoisingCC
PSNR33.51
40
Image DenoisingMcMaster (test)
PSNR34.19
32
Image DenoisingFMDD
PSNR31.65
31
Image DenoisingKodak Gaussian σ=25 (test)
PSNR29.46
24
Image DenoisingSIDD 1 (val)
PSNR25.59
23
Image DenoisingCSet (test)
PSNR33.87
21
Showing 10 of 30 rows

Other info

Follow for update