Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Deep Gaussian Scale Mixture Prior for Spectral Compressive Imaging

About

In coded aperture snapshot spectral imaging (CASSI) system, the real-world hyperspectral image (HSI) can be reconstructed from the captured compressive image in a snapshot. Model-based HSI reconstruction methods employed hand-crafted priors to solve the reconstruction problem, but most of which achieved limited success due to the poor representation capability of these hand-crafted priors. Deep learning based methods learning the mappings between the compressive images and the HSIs directly achieved much better results. Yet, it is nontrivial to design a powerful deep network heuristically for achieving satisfied results. In this paper, we propose a novel HSI reconstruction method based on the Maximum a Posterior (MAP) estimation framework using learned Gaussian Scale Mixture (GSM) prior. Different from existing GSM models using hand-crafted scale priors (e.g., the Jeffrey's prior), we propose to learn the scale prior through a deep convolutional neural network (DCNN). Furthermore, we also propose to estimate the local means of the GSM models by the DCNN. All the parameters of the MAP estimation algorithm and the DCNN parameters are jointly optimized through end-to-end training. Extensive experimental results on both synthetic and real datasets demonstrate that the proposed method outperforms existing state-of-the-art methods. The code is available at https://see.xidian.edu.cn/faculty/wsdong/Projects/DGSM-SCI.htm.

Tao Huang, Weisheng Dong, Xin Yuan, Jinjian Wu, Guangming Shi• 2021

Related benchmarks

TaskDatasetResultRank
HSI ReconstructionKAIST 10 scenes (Scene2)
PSNR32.09
39
Hyperspectral Image ReconstructionKAIST 10 simulation scenes (test)
PSNR32.63
30
Hyperspectral Image ReconstructionKAIST simulation (Average test)
PSNR32.63
26
HSI ReconstructionKAIST 10 scenes (Scene5)
PSNR28.86
25
Multispectral Image ReconstructionKAIST simulation S4
PSNR40.54
16
Multispectral Image ReconstructionKAIST simulation S8
PSNR31.55
16
Multispectral Image ReconstructionKAIST simulation S10
PSNR31.44
16
Multispectral Image ReconstructionKAIST simulation S6
PSNR33.08
16
Multispectral Image ReconstructionKAIST S1 (simulation)
PSNR33.26
16
Multispectral Image ReconstructionKAIST S3 (simulation)
PSNR33.06
16
Showing 10 of 32 rows

Other info

Follow for update