Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

HIR-ALIGN: Enhancing Hyperspectral Image Restoration via Diffusion-Based Data Generation

About

Hyperspectral image (HSI) restoration is crucial for reliable analysis, as real-world HSIs suffer from noise, blur, and resolution loss. However, existing models trained on source data often fail on target domains lacking clean references, a common real-world scenario. To address this, we present HIR-ALIGN, a plug-and-play target-adaptive augmentation framework that enhances HSI restoration by augmenting limited training images with synthetic data matching the target distribution, without extra clean target-domain HSI data. It has three stages: (i) proxy generation, where off-the-shelf restoration models are applied to degraded target observations to produce semantics-preserving proxy HSIs that approximate clean target-domain images; (ii) distribution-adaptive synthesis, where a blur-robust unCLIP diffusion model generates target-aligned RGBs from proxy RGBs with prompt conditioning and embedding-space noise initialization. The warp-based spectral transfer module then synthesizes HSIs by aligning each generated RGB with its proxy RGB, estimating soft patch-wise transport weights, and applying these weights and learnable local interpolation kernels to the proxy HSI; and (iii) aligned supervised finetuning, where restoration networks pretrained on the source distribution are finetuned with proxy HSIs and synthesized target-aligned HSIs, then deployed on degraded target images. We also provide theoretical analysis showing that, under stated assumptions, the proposed augmentation-based finetuning obtains a tighter target-domain restoration-risk upper bound by jointly improving target-distribution coverage and controlling spectral bias. Experiments on simulated and real datasets across denoising, super-resolution, and other restoration tasks demonstrate that HIR-ALIGN is superior to proxy-only target-adaptation baselines and outperforms representative unsupervised methods in most cases.

Li Pang, Heng Zhao, Yijia Zhang, Deyu Meng, Xiangyong Cao• 2026

Related benchmarks

TaskDatasetResultRank
Gaussian DenoisingCAVE
PSNR42.36
11
Gaussian DenoisingKAIST
PSNR42.04
11
Complex DenoisingCAVE
PSNR42.43
10
Complex DenoisingKAIST
PSNR41.8
10
DenoisingHSIDwrD
PSNR24.72
10
Super-ResolutionCAVE
PSNR37.66
10
Super-ResolutionKAIST
PSNR35.63
10
Showing 7 of 7 rows

Other info

Follow for update