Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

From Darkness to Detail: Frequency-Aware SSMs for Low-Light Vision

About

Low-light image enhancement remains a persistent challenge in computer vision, where state-of-the-art models are often hampered by hardware constraints and computational inefficiency, particularly at high resolutions. While foundational architectures like transformers and diffusion models have advanced the field, their computational complexity limits their deployment on edge devices. We introduce ExpoMamba, a novel architecture that integrates a frequency-aware state-space model within a modified U-Net. ExpoMamba is designed to address mixed-exposure challenges by decoupling the modeling of amplitude (intensity) and phase (structure) in the frequency domain. This allows for targeted enhancement, making it highly effective for real-time applications, including downstream tasks like object detection and segmentation. Our experiments on six benchmark datasets show that ExpoMamba is up to 2-3x faster than competing models and achieves a 6.8\% PSNR improvement, establishing a new state-of-the-art in efficient, high-quality low-light enhancement. Source code: https://www.github.com/eashanadhikarla/ExpoMamba.

Eashan Adhikarla, Kai Zhang, Gong Chen, John Nicholson, Brian D. Davison• 2024

Related benchmarks

TaskDatasetResultRank
Low-light Image EnhancementLOL v1
PSNR25.77
51
Low-light Image EnhancementLOL Real_captured v2
PSNR28.04
47
Semantic segmentationACDC (Night)
mIoU64.3
38
Image EnhancementSICE Underexposure v2
PSNR22.59
34
Image EnhancementSICE Overexposure v2
PSNR22.29
17
Object DetectionExDark
mAP (Mean Average Precision)79.8
17
Low-light Image EnhancementLOL4K UHD (test)
PSNR35.23
15
Low-light Image EnhancementLOLv2 (test)
PSNR28.04
6
Showing 8 of 8 rows

Other info

Code

Follow for update