Zero-Reference Low-Light Enhancement via Physical Quadruple Priors
About
Understanding illumination and reducing the need for supervision pose a significant challenge in low-light enhancement. Current approaches are highly sensitive to data usage during training and illumination-specific hyper-parameters, limiting their ability to handle unseen scenarios. In this paper, we propose a new zero-reference low-light enhancement framework trainable solely with normal light images. To accomplish this, we devise an illumination-invariant prior inspired by the theory of physical light transfer. This prior serves as the bridge between normal and low-light images. Then, we develop a prior-to-image framework trained without low-light data. During testing, this framework is able to restore our illumination-invariant prior back to images, automatically achieving low-light enhancement. Within this framework, we leverage a pretrained generative diffusion model for model ability, introduce a bypass decoder to handle detail distortion, as well as offer a lightweight version for practicality. Extensive experiments demonstrate our framework's superiority in various scenarios as well as good interpretability, robustness, and efficiency. Code is available on our project homepage: http://daooshee.github.io/QuadPrior-Website/
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Low-light Image Enhancement | LOL real v2 (test) | PSNR23.633 | 122 | |
| Low-light Image Enhancement | LOL v1 | PSNR22.849 | 84 | |
| Low-light Image Enhancement | LOL real v2 | PSNR20.59 | 81 | |
| Low-light Image Enhancement | LOL Syn v2 (test) | PSNR19.131 | 78 | |
| Low-light Image Enhancement | LOL v1 | SSIM0.8 | 34 | |
| Low-light Image Enhancement | VE-LOL-L v1 (test) | FID69.945 | 28 | |
| Low-light Image Enhancement | LOL real v2 | PSNR20.592 | 26 | |
| Human Pose Estimation | ExLPose LL-N (test) | AP@0.5:0.9519.3 | 21 | |
| Human Pose Estimation | ExLPose LL-E (test) | AP (0.5:0.95)0.3 | 21 | |
| Low-light Video Enhancement | SMID | PSNR26.36 | 18 |