Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

ECMamba: Consolidating Selective State Space Model with Retinex Guidance for Efficient Multiple Exposure Correction

About

Exposure Correction (EC) aims to recover proper exposure conditions for images captured under over-exposure or under-exposure scenarios. While existing deep learning models have shown promising results, few have fully embedded Retinex theory into their architecture, highlighting a gap in current methodologies. Additionally, the balance between high performance and efficiency remains an under-explored problem for exposure correction task. Inspired by Mamba which demonstrates powerful and highly efficient sequence modeling, we introduce a novel framework based on Mamba for Exposure Correction (ECMamba) with dual pathways, each dedicated to the restoration of reflectance and illumination map, respectively. Specifically, we firstly derive the Retinex theory and we train a Retinex estimator capable of mapping inputs into two intermediary spaces, each approximating the target reflectance and illumination map, respectively. This setup facilitates the refined restoration process of the subsequent Exposure Correction Mamba Module (ECMM). Moreover, we develop a novel 2D Selective State-space layer guided by Retinex information (Retinex-SS2D) as the core operator of ECMM. This architecture incorporates an innovative 2D scanning strategy based on deformable feature aggregation, thereby enhancing both efficiency and effectiveness. Extensive experiment results and comprehensive ablation studies demonstrate the outstanding performance and the importance of each component of our proposed ECMamba. Code is available at https://github.com/LowlevelAI/ECMamba.

Wei Dong, Han Zhou, Yulun Zhang, Xiaohong Liu, Jun Chen• 2024

Related benchmarks

TaskDatasetResultRank
Low-light Image EnhancementLOL real v2 (test)
PSNR29.24
104
Low-light Image EnhancementLOL Syn v2 (test)
PSNR29.94
78
Multi-exposure CorrectionME Dataset (Under-exposed)
PSNR23.64
24
Multi-exposure CorrectionME Dataset Over-exposed
PSNR23.84
24
Multi-exposure CorrectionSICE Dataset Over-exposed
PSNR21.23
23
Multi-exposure CorrectionME Dataset (Average)
PSNR23.76
13
Multi-exposure CorrectionSICE Dataset Under-exposed
PSNR22.87
12
Multi-exposure CorrectionSICE Dataset (Average)
PSNR22.05
12
Showing 8 of 8 rows

Other info

Code

Follow for update