A Deep Cascade of Convolutional Neural Networks for Dynamic MR Image Reconstruction
About
Inspired by recent advances in deep learning, we propose a framework for reconstructing dynamic sequences of 2D cardiac magnetic resonance (MR) images from undersampled data using a deep cascade of convolutional neural networks (CNNs) to accelerate the data acquisition process. In particular, we address the case where data is acquired using aggressive Cartesian undersampling. Firstly, we show that when each 2D image frame is reconstructed independently, the proposed method outperforms state-of-the-art 2D compressed sensing approaches such as dictionary learning-based MR image reconstruction, in terms of reconstruction error and reconstruction speed. Secondly, when reconstructing the frames of the sequences jointly, we demonstrate that CNNs can learn spatio-temporal correlations efficiently by combining convolution and data sharing approaches. We show that the proposed method consistently outperforms state-of-the-art methods and is capable of preserving anatomical structure more faithfully up to 11-fold undersampling. Moreover, reconstruction is very fast: each complete dynamic sequence can be reconstructed in less than 10s and, for the 2D case, each image frame can be reconstructed in 23ms, enabling real-time applications.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Image Reconstruction | ImageNet | PSNR33.9 | 56 | |
| MRI Reconstruction | fastMRI 4X acceleration (test) | PSNR32.25 | 32 | |
| Image Reconstruction | CIFAR-10 | -- | 25 | |
| MRI Reconstruction | fastMRI knee 4x acceleration single coil (val) | PSNR32.25 | 18 | |
| MRI Reconstruction | fastMRI knee 8x acceleration single-coil (val) | PSNR29.65 | 18 | |
| MRI Reconstruction | T1-weighted StarVIBE liver cohort (test) | DCI0.42 | 16 | |
| MRI Reconstruction | FastMRI single-coil knee (test) | PSNR31.97 | 12 | |
| MRI Reconstruction | fastMRI 8X acceleration (test) | SSIM0.6457 | 11 | |
| MRI Reconstruction | FastMRI knee single-coil (test) | PSNR29.52 | 10 | |
| Undersampled MRI Reconstruction | Brain MRI | PSNR (dB)40.85 | 10 |