Zero-Reference Low-Light Enhancement via Physical Quadruple Priors
About
Understanding illumination and reducing the need for supervision pose a significant challenge in low-light enhancement. Current approaches are highly sensitive to data usage during training and illumination-specific hyper-parameters, limiting their ability to handle unseen scenarios. In this paper, we propose a new zero-reference low-light enhancement framework trainable solely with normal light images. To accomplish this, we devise an illumination-invariant prior inspired by the theory of physical light transfer. This prior serves as the bridge between normal and low-light images. Then, we develop a prior-to-image framework trained without low-light data. During testing, this framework is able to restore our illumination-invariant prior back to images, automatically achieving low-light enhancement. Within this framework, we leverage a pretrained generative diffusion model for model ability, introduce a bypass decoder to handle detail distortion, as well as offer a lightweight version for practicality. Extensive experiments demonstrate our framework's superiority in various scenarios as well as good interpretability, robustness, and efficiency. Code is available on our project homepage: http://daooshee.github.io/QuadPrior-Website/
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Low-light Image Enhancement | LOL real v2 (test) | PSNR23.633 | 104 | |
| Low-light Image Enhancement | LOL Syn v2 (test) | PSNR19.131 | 78 | |
| Low-light Image Enhancement | VE-LOL-L v1 (test) | FID69.945 | 28 | |
| Low-light Video Enhancement | SMID | PSNR26.36 | 18 | |
| Low-light Video Enhancement | DID | PSNR22.84 | 18 | |
| Low-light Video Enhancement | SDSD indoor | PSNR25.53 | 18 | |
| Low-light Video Enhancement | SDSD outdoor | PSNR22.42 | 18 | |
| Low-light Image Enhancement | VILNC-Indoor 1.0 (test) | PSNR11.293 | 16 | |
| Low-light Image Enhancement | LSRW (Huawei) 1.0 (test) | PSNR18.31 | 14 | |
| Low-light Image Enhancement | LSRW Nikon 1.0 (test) | PSNR14.84 | 13 |