Solving Inverse Problems in Medical Imaging with Score-Based Generative Models
About
Reconstructing medical images from partial measurements is an important inverse problem in Computed Tomography (CT) and Magnetic Resonance Imaging (MRI). Existing solutions based on machine learning typically train a model to directly map measurements to medical images, leveraging a training dataset of paired images and measurements. These measurements are typically synthesized from images using a fixed physical model of the measurement process, which hinders the generalization capability of models to unknown measurement processes. To address this issue, we propose a fully unsupervised technique for inverse problem solving, leveraging the recently introduced score-based generative models. Specifically, we first train a score-based generative model on medical images to capture their prior distribution. Given measurements and a physical model of the measurement process at test time, we introduce a sampling method to reconstruct an image consistent with both the prior and the observed measurements. Our method does not assume a fixed measurement process during training, and can thus be flexibly adapted to different measurement processes at test time. Empirically, we observe comparable or better performance to supervised learning techniques in several medical imaging tasks in CT and MRI, while demonstrating significantly better generalization to unknown measurement processes.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Sparse-View CT Reconstruction | LIDC Coronal View (test) | PSNR32.51 | 24 | |
| Sparse-View CT Reconstruction | LIDC | PSNR31.65 | 24 | |
| Sparse-View CT Reconstruction | LIDC Sagittal View (test) | PSNR31.8 | 24 | |
| Sparse-View CT Reconstruction | AAPM | PSNR33.19 | 21 | |
| Sparse-View CT Reconstruction | AAPM Sagittal View (test) | PSNR33.43 | 21 | |
| Sparse-View CT Reconstruction | AAPM Coronal View (test) | PSNR33.97 | 21 | |
| Metal Artifact Reduction | DeepLesion 43 (test) | PSNR31.66 | 10 | |
| Metal Artifact Reduction | XCOM 44 (test) | PSNR24.92 | 10 | |
| Limited-Angle CT Reconstruction | LIDC Axial | PSNR28.12 | 8 | |
| Limited-Angle CT Reconstruction | LIDC Sagittal | PSNR28.06 | 8 |