SSUMamba: Spatial-Spectral Selective State Space Model for Hyperspectral Image Denoising
About
Denoising is a crucial preprocessing step for hyperspectral images (HSIs) due to noise arising from intra-imaging mechanisms and environmental factors. Long-range spatial-spectral correlation modeling is beneficial for HSI denoising but often comes with high computational complexity. Based on the state space model (SSM), Mamba is known for its remarkable long-range dependency modeling capabilities and computational efficiency. Building on this, we introduce a memory-efficient spatial-spectral UMamba (SSUMamba) for HSI denoising, with the spatial-spectral continuous scan (SSCS) Mamba being the core component. SSCS Mamba alternates the row, column, and band in six different orders to generate the sequence and uses the bidirectional SSM to exploit long-range spatial-spectral dependencies. In each order, the images are rearranged between adjacent scans to ensure spatial-spectral continuity. Additionally, 3D convolutions are embedded into the SSCS Mamba to enhance local spatial-spectral modeling. Experiments demonstrate that SSUMamba achieves superior denoising results with lower memory consumption per batch compared to transformer-based methods. The source code is available at https://github.com/lronkitty/SSUMamba.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Hyperspectral Image Denoising | ICVL Mixture Noise (test) | PSNR43.07 | 15 | |
| HSI Denoising | Huston 2018 | PSNR34.74 | 15 | |
| HSI Denoising | PAVIA CITY CENTER | PSNR35.7 | 15 | |
| Hyperspectral Image Denoising | ICVL Gaussian noise σ ∈ [0, 15] (test) | PSNR51.34 | 15 | |
| Hyperspectral Image Denoising | ICVL Gaussian noise σ ∈ [0, 55] (test) | PSNR46.85 | 15 | |
| Hyperspectral Image Denoising | ICVL Gaussian noise σ ∈ [0, 95] (test) | PSNR45.36 | 15 | |
| HSI Denoising | GAOFEN-5 WUHAN | TOPIQ NR0.4969 | 13 | |
| HSI Denoising | EARTH OBSERVING-1 | TOPIQ NR Score0.6074 | 13 |