Progressively Volumetrized Deep Generative Models for Data-Efficient Contextual Learning of MR Image Recovery
About
Magnetic resonance imaging (MRI) offers the flexibility to image a given anatomic volume under a multitude of tissue contrasts. Yet, scan time considerations put stringent limits on the quality and diversity of MRI data. The gold-standard approach to alleviate this limitation is to recover high-quality images from data undersampled across various dimensions, most commonly the Fourier domain or contrast sets. A primary distinction among recovery methods is whether the anatomy is processed per volume or per cross-section. Volumetric models offer enhanced capture of global contextual information, but they can suffer from suboptimal learning due to elevated model complexity. Cross-sectional models with lower complexity offer improved learning behavior, yet they ignore contextual information across the longitudinal dimension of the volume. Here, we introduce a novel progressive volumetrization strategy for generative models (ProvoGAN) that serially decomposes complex volumetric image recovery tasks into successive cross-sectional mappings task-optimally ordered across individual rectilinear dimensions. ProvoGAN effectively captures global context and recovers fine-structural details across all dimensions, while maintaining low model complexity and improved learning behaviour. Comprehensive demonstrations on mainstream MRI reconstruction and synthesis tasks show that ProvoGAN yields superior performance to state-of-the-art volumetric and cross-sectional models.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Multi-contrast MRI Synthesis (T2, PD -> T1) | IXI (test) | PSNR24.21 | 23 | |
| Multi-contrast MRI Synthesis (T1, PD -> T2) | IXI (test) | PSNR29.19 | 17 | |
| Multi-contrast MRI Synthesis (T1, T2 -> PD) | IXI (test) | PSNR29.93 | 17 | |
| MRI Synthesis (T1+T1ce+FLAIR to T2) | BraST | PSNR26.72 | 6 | |
| MRI Synthesis (T2+T1ce+FLAIR to T1) | BraST | PSNR27.79 | 6 | |
| MRI Synthesis (T1+PD to T2) | IXI | PSNR29.19 | 6 | |
| Multi-modal MRI Synthesis (T1+T1ce+FLAIR to T2) | BraTS 2018 (test) | PSNR26.72 | 5 | |
| Multi-modal MRI Synthesis (T2+T1+FLAIR to T1ce) | BraTS 2018 (test) | PSNR29.26 | 5 | |
| Multi-modal MRI Synthesis (T2+T1ce+FLAIR to T1) | BraTS 2018 (test) | PSNR27.79 | 5 | |
| Multi-modal MRI Synthesis (T2+T1ce+T1 to FLAIR) | BraTS 2018 (test) | PSNR25.64 | 5 |