Robust Compressed Sensing MRI with Deep Generative Priors
About
The CSGM framework (Bora-Jalal-Price-Dimakis'17) has shown that deep generative priors can be powerful tools for solving inverse problems. However, to date this framework has been empirically successful only on certain datasets (for example, human faces and MNIST digits), and it is known to perform poorly on out-of-distribution samples. In this paper, we present the first successful application of the CSGM framework on clinical MRI data. We train a generative prior on brain scans from the fastMRI dataset, and show that posterior sampling via Langevin dynamics achieves high quality reconstructions. Furthermore, our experiments and theory show that posterior sampling is robust to changes in the ground-truth distribution and measurement process. Our code and models are available at: \url{https://github.com/utcsilab/csgm-mri-langevin}.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| MRI Reconstruction | fastMRI Knee (test) | SSIM67.89 | 26 | |
| Sparse-View CT Reconstruction | AAPM-LDCT 18-view | RMSE148.1 | 23 | |
| Sparse-View CT Reconstruction | Kidney CT dataset 18-view | RMSE (HU)92.26 | 14 | |
| Sparse-View CT Reconstruction | Kidney CT dataset 36-view | RMSE (HU)53.21 | 8 | |
| Sparse-View CT Reconstruction | Kidney CT dataset 72-view | RMSE (HU)43.28 | 8 | |
| Sparse-View CT Reconstruction | AAPM abdominal Low Dose CT 36-view (test) | RMSE (HU)110.2 | 8 | |
| Sparse-View CT Reconstruction | AAPM abdominal Low Dose CT 72-view (test) | RMSE (HU)85.17 | 8 | |
| Compressed sensing MRI | fastMRI knee x4 subsampling | PSNR28.78 | 5 | |
| Compressed sensing MRI | fastMRI knee x8 subsampling | PSNR26.15 | 5 | |
| Sparse-View CT Reconstruction | Kidney CT dataset | Inference Time (s)32.72 | 4 |