Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

MambaLLIE: Implicit Retinex-Aware Low Light Enhancement with Global-then-Local State Space

About

Recent advances in low light image enhancement have been dominated by Retinex-based learning framework, leveraging convolutional neural networks (CNNs) and Transformers. However, the vanilla Retinex theory primarily addresses global illumination degradation and neglects local issues such as noise and blur in dark conditions. Moreover, CNNs and Transformers struggle to capture global degradation due to their limited receptive fields. While state space models (SSMs) have shown promise in the long-sequence modeling, they face challenges in combining local invariants and global context in visual data. In this paper, we introduce MambaLLIE, an implicit Retinex-aware low light enhancer featuring a global-then-local state space design. We first propose a Local-Enhanced State Space Module (LESSM) that incorporates an augmented local bias within a 2D selective scan mechanism, enhancing the original SSMs by preserving local 2D dependency. Additionally, an Implicit Retinex-aware Selective Kernel module (IRSK) dynamically selects features using spatially-varying operations, adapting to varying inputs through an adaptive kernel selection process. Our Global-then-Local State Space Block (GLSSB) integrates LESSM and IRSK with LayerNorm as its core. This design enables MambaLLIE to achieve comprehensive global long-range modeling and flexible local feature aggregation. Extensive experiments demonstrate that MambaLLIE significantly outperforms state-of-the-art CNN and Transformer-based methods. Project Page: https://mamballie.github.io/anon/

Jiangwei Weng, Zhiqiang Yan, Ying Tai, Jianjun Qian, Jian Yang, Jun Li• 2024

Related benchmarks

TaskDatasetResultRank
Low-light Image EnhancementLOL v1
PSNR23.36
135
Low-light Image EnhancementLOL real v2
PSNR22.95
122
Low-light Image EnhancementLOL syn v2
PSNR25.87
118
Low-light Image EnhancementSID
PSNR21.88
63
Low-light Image EnhancementSDSD-out
PSNR30
52
Low-light Image EnhancementSMID
PSNR29.26
48
Low-light Image EnhancementSDSD indoor
PSNR30.12
30
Low-light Image EnhancementMILL-s DSLR
PSNRL25.989
28
Low-light Image EnhancementMILL (Smartphone)
PSNR22.638
15
Low-light Image EnhancementLOLv2 (test)
PSNR22.95
6
Showing 10 of 10 rows

Other info

Follow for update