Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

SpectraLift: Physics-Guided Spectral-Inversion Network for Self-Supervised Hyperspectral Image Super-Resolution

About

High-spatial-resolution hyperspectral images (HSI) are essential for applications such as remote sensing and medical imaging, yet HSI sensors inherently trade spatial detail for spectral richness. Fusing high-spatial-resolution multispectral images (HR-MSI) with low-spatial-resolution hyperspectral images (LR-HSI) is a promising route to recover fine spatial structures without sacrificing spectral fidelity. Most state-of-the-art methods for HSI-MSI fusion demand point spread function (PSF) calibration or ground truth high resolution HSI (HR-HSI), both of which are impractical to obtain in real world settings. We present SpectraLift, a fully self-supervised framework that fuses LR-HSI and HR-MSI inputs using only the MSI's Spectral Response Function (SRF). SpectraLift trains a lightweight per-pixel multi-layer perceptron (MLP) network using ($i$)~a synthetic low-spatial-resolution multispectral image (LR-MSI) obtained by applying the SRF to the LR-HSI as input, ($ii$)~the LR-HSI as the output, and ($iii$)~an $\ell_1$ spectral reconstruction loss between the estimated and true LR-HSI as the optimization objective. At inference, SpectraLift uses the trained network to map the HR-MSI pixel-wise into a HR-HSI estimate. SpectraLift converges in minutes, is agnostic to spatial blur and resolution, and outperforms state-of-the-art methods on PSNR, SAM, SSIM, and RMSE benchmarks.

Ritik Shah, Marco F. Duarte• 2025

Related benchmarks

TaskDatasetResultRank
Hyperspectral Image Super-ResolutionKennedy Space Center
RMSE0.0447
20
Hyperspectral Image Super-ResolutionPavia University Mean value of 80 LR HSI-HR MSI configurations
RMSE0.0307
20
Hyperspectral Super-ResolutionBotswana
RMSE0.0145
11
Hyperspectral Super-ResolutionWashington DC Mall 80 LR-HSI/HR-MSI configurations
RMSE0.0234
11
Hyperspectral Image Super-ResolutionPavia Center (test)
RMSE0.0272
11
Hyperspectral Image Super-ResolutionWashington DC without 1 band HR image (test)
RMSE0.0127
9
Hyperspectral Image Super-ResolutionKennedy Space Center without 1 band HR image
RMSE0.0418
9
Hyperspectral Image Super-ResolutionPavia University without 1 band HR image Mean value of 70 LR HSI-HR MSI configurations (test)
RMSE0.0187
9
Hyperspectral Image Super-ResolutionPavia Center without 1 band HR image
RMSE0.0161
9
Hyperspectral Image Super-ResolutionWashington DC Mall
RMSE0.0234
9
Showing 10 of 13 rows

Other info

Follow for update