Learning Camera-Aware Noise Models
About
Modeling imaging sensor noise is a fundamental problem for image processing and computer vision applications. While most previous works adopt statistical noise models, real-world noise is far more complicated and beyond what these models can describe. To tackle this issue, we propose a data-driven approach, where a generative noise model is learned from real-world noise. The proposed noise model is camera-aware, that is, different noise characteristics of different camera sensors can be learned simultaneously, and a single learned noise model can generate different noise for different camera sensors. Experimental results show that our method quantitatively and qualitatively outperforms existing statistical noise models and learning-based methods.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Image Denoising | SIDD (test) | PSNR45 | 97 | |
| Noise Synthesis | SIDD (test) | DKL0.0178 | 13 | |
| Image Denoising | SIDD Google Pixel (test) | PSNR45.96 | 8 | |
| Image Denoising | SIDD iPhone 7 (test) | PSNR55.48 | 8 | |
| Image Denoising | SIDD (S6 camera, ISO 100) | PSNR52.85 | 6 | |
| Image Denoising | SIDD S6 camera, ISO 800 | PSNR48.2 | 6 | |
| Image Denoising | SIDD S6 camera, ISO 1600 | PSNR47.93 | 6 | |
| Image Denoising | SIDD S6 camera, ISO 3200 | PSNR42.9 | 6 | |
| Image Denoising | SIDD S6 camera, All ISOs | PSNR49.19 | 6 | |
| Noise Synthesis | SIDD (GP) | KL Divergence0.0146 | 5 |