Noise2Same: Optimizing A Self-Supervised Bound for Image Denoising
About
Self-supervised frameworks that learn denoising models with merely individual noisy images have shown strong capability and promising performance in various image denoising tasks. Existing self-supervised denoising frameworks are mostly built upon the same theoretical foundation, where the denoising models are required to be J-invariant. However, our analyses indicate that the current theory and the J-invariance may lead to denoising models with reduced performance. In this work, we introduce Noise2Same, a novel self-supervised denoising framework. In Noise2Same, a new self-supervised loss is proposed by deriving a self-supervised upper bound of the typical supervised loss. In particular, Noise2Same requires neither J-invariance nor extra information about the noise model and can be used in a wider range of denoising applications. We analyze our proposed Noise2Same both theoretically and experimentally. The experimental results show that our Noise2Same remarkably outperforms previous self-supervised denoising methods in terms of denoising performance and training efficiency. Our code is available at https://github.com/divelab/Noise2Same.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Image Denoising | Kodak Gaussian σ=25 (test) | PSNR30.77 | 24 | |
| Gaussian Denoising | BSDS300 sigma=25 sRGB | PSNR29.5 | 24 | |
| Image Denoising | CBSD68 Gaussian noise, σ = 25 (test) | PSNR28 | 17 | |
| Image Denoising | CBSD68 Poisson noise, ζ = 0.01 (test) | PSNR29.32 | 16 | |
| Image Denoising | Set14 Gaussian σ=25 (test) | PSNR29.53 | 16 | |
| Image Denoising | Kodak Gaussian σ∈[5, 50] (test) | PSNR30.78 | 15 | |
| Image Denoising | BSD300 Gaussian σ∈[5, 50] (test) | PSNR29.49 | 15 | |
| Image Denoising | Set14 Gaussian σ∈[5, 50] (test) | PSNR29.34 | 15 | |
| Image Denoising | Kodak Poisson λ=30 (test) | PSNR27.73 | 15 | |
| Image Denoising | BSD300 Poisson λ=30 (test) | PSNR26.69 | 15 |