Zero-Shot Noise2Noise: Efficient Image Denoising without any Data
About
Recently, self-supervised neural networks have shown excellent image denoising performance. However, current dataset free methods are either computationally expensive, require a noise model, or have inadequate image quality. In this work we show that a simple 2-layer network, without any training data or knowledge of the noise distribution, can enable high-quality image denoising at low computational cost. Our approach is motivated by Noise2Noise and Neighbor2Neighbor and works well for denoising pixel-wise independent noise. Our experiments on artificial, real-world camera, and microscope noise show that our method termed ZS-N2N (Zero Shot Noise2Noise) often outperforms existing dataset-free methods at a reduced cost, making it suitable for use cases with scarce data availability and limited computational resources. A demo of our implementation including our code and hyperparameters can be found in the following colab notebook: https://colab.research.google.com/drive/1i82nyizTdszyHkaHBuKPbWnTzao8HF9b
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Image Denoising | SIDD (val) | PSNR25.59 | 105 | |
| Image Denoising | SIDD Benchmark | PSNR30.19 | 61 | |
| Image Denoising | PolyU | PSNR35.99 | 56 | |
| Image Denoising | Kodak (test) | PSNR31.02 | 42 | |
| Image Denoising | CC | PSNR33.51 | 40 | |
| Image Denoising | McMaster (test) | PSNR34.19 | 32 | |
| Image Denoising | FMDD | PSNR31.65 | 31 | |
| Image Denoising | Kodak Gaussian σ=25 (test) | PSNR29.46 | 24 | |
| Image Denoising | SIDD 1 (val) | PSNR25.59 | 23 | |
| Image Denoising | CSet (test) | PSNR33.87 | 21 |