Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

EnlightenGAN: Deep Light Enhancement without Paired Supervision

About

Deep learning-based methods have achieved remarkable success in image restoration and enhancement, but are they still competitive when there is a lack of paired training data? As one such example, this paper explores the low-light image enhancement problem, where in practice it is extremely challenging to simultaneously take a low-light and a normal-light photo of the same visual scene. We propose a highly effective unsupervised generative adversarial network, dubbed EnlightenGAN, that can be trained without low/normal-light image pairs, yet proves to generalize very well on various real-world test images. Instead of supervising the learning using ground truth data, we propose to regularize the unpaired training using the information extracted from the input itself, and benchmark a series of innovations for the low-light image enhancement problem, including a global-local discriminator structure, a self-regularized perceptual loss fusion, and attention mechanism. Through extensive experiments, our proposed approach outperforms recent methods under a variety of metrics in terms of visual quality and subjective user study. Thanks to the great flexibility brought by unpaired training, EnlightenGAN is demonstrated to be easily adaptable to enhancing real-world images from various domains. The code is available at \url{https://github.com/yueruchen/EnlightenGAN}

Yifan Jiang, Xinyu Gong, Ding Liu, Yu Cheng, Chen Fang, Xiaohui Shen, Jianchao Yang, Pan Zhou, Zhangyang Wang• 2019

Related benchmarks

TaskDatasetResultRank
Low-light Image EnhancementLOL
PSNR17.483
122
Low-light Image EnhancementLOL v1
PSNR20
113
Low-light Image EnhancementLOL real v2 (test)
PSNR18.676
104
Low-light Image EnhancementLOL (test)
PSNR17.483
97
Low-light Image EnhancementLOL syn v2
PSNR16.57
87
Low-light Image EnhancementLOL real v2
PSNR18.23
83
Low-light Image EnhancementLOL Syn v2 (test)
PSNR16.57
78
Novel View SynthesisRe10K (test)
PSNR15.57
66
Low-light enhancementLOL v1 (test)
PSNR17.48
53
Low-light Image EnhancementLOL v1
PSNR17.606
51
Showing 10 of 104 rows
...

Other info

Code

Follow for update