Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Efficient Diffusion as Low Light Enhancer

About

The computational burden of the iterative sampling process remains a major challenge in diffusion-based Low-Light Image Enhancement (LLIE). Current acceleration methods, whether training-based or training-free, often lead to significant performance degradation, highlighting the trade-off between performance and efficiency. In this paper, we identify two primary factors contributing to performance degradation: fitting errors and the inference gap. Our key insight is that fitting errors can be mitigated by linearly extrapolating the incorrect score functions, while the inference gap can be reduced by shifting the Gaussian flow to a reflectance-aware residual space. Based on the above insights, we design Reflectance-Aware Trajectory Refinement (RATR) module, a simple yet effective module to refine the teacher trajectory using the reflectance component of images. Following this, we introduce \textbf{Re}flectance-aware \textbf{D}iffusion with \textbf{Di}stilled \textbf{T}rajectory (\textbf{ReDDiT}), an efficient and flexible distillation framework tailored for LLIE. Our framework achieves comparable performance to previous diffusion-based methods with redundant steps in just 2 steps while establishing new state-of-the-art (SOTA) results with 8 or 4 steps. Comprehensive experimental evaluations on 10 benchmark datasets validate the effectiveness of our method, consistently outperforming existing SOTA methods.

Guanzhou Lan, Qianli Ma, Yuqi Yang, Zhigang Wang, Dong Wang, Xuelong Li, Bin Zhao• 2024

Related benchmarks

TaskDatasetResultRank
Low-light Image EnhancementLOL real v2
PSNR31.25
81
Low-light Image EnhancementLOL v1
PSNR28.09
69
Low-light Image EnhancementSID
PSNR25.88
63
Low-light Image EnhancementDICM
NIQE3.62
58
Low-light Image EnhancementMEF
NIQE3.93
58
Low-light Image EnhancementNPE
NIQE3.24
50
Low-light Image EnhancementLIME
NIQE Score3.45
50
Low-light Image EnhancementVV
NIQE3
47
Low-light Image EnhancementSDSD
PSNR29.95
45
Low-light Image EnhancementLOL synthetic v2
PSNR30.166
44
Showing 10 of 11 rows

Other info

Follow for update