Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

SSUMamba: Spatial-Spectral Selective State Space Model for Hyperspectral Image Denoising

About

Denoising is a crucial preprocessing step for hyperspectral images (HSIs) due to noise arising from intra-imaging mechanisms and environmental factors. Long-range spatial-spectral correlation modeling is beneficial for HSI denoising but often comes with high computational complexity. Based on the state space model (SSM), Mamba is known for its remarkable long-range dependency modeling capabilities and computational efficiency. Building on this, we introduce a memory-efficient spatial-spectral UMamba (SSUMamba) for HSI denoising, with the spatial-spectral continuous scan (SSCS) Mamba being the core component. SSCS Mamba alternates the row, column, and band in six different orders to generate the sequence and uses the bidirectional SSM to exploit long-range spatial-spectral dependencies. In each order, the images are rearranged between adjacent scans to ensure spatial-spectral continuity. Additionally, 3D convolutions are embedded into the SSCS Mamba to enhance local spatial-spectral modeling. Experiments demonstrate that SSUMamba achieves superior denoising results with lower memory consumption per batch compared to transformer-based methods. The source code is available at https://github.com/lronkitty/SSUMamba.

Guanyiman Fu, Fengchao Xiong, Jianfeng Lu, Jun Zhou• 2024

Related benchmarks

TaskDatasetResultRank
Hyperspectral Image DenoisingICVL Mixture Noise (test)
PSNR43.07
15
HSI DenoisingHuston 2018
PSNR34.74
15
HSI DenoisingPAVIA CITY CENTER
PSNR35.7
15
Hyperspectral Image DenoisingICVL Gaussian noise σ ∈ [0, 15] (test)
PSNR51.34
15
Hyperspectral Image DenoisingICVL Gaussian noise σ ∈ [0, 55] (test)
PSNR46.85
15
Hyperspectral Image DenoisingICVL Gaussian noise σ ∈ [0, 95] (test)
PSNR45.36
15
HSI DenoisingGAOFEN-5 WUHAN
TOPIQ NR0.4969
13
HSI DenoisingEARTH OBSERVING-1
TOPIQ NR Score0.6074
13
Showing 8 of 8 rows

Other info

Follow for update