Conditional Diffusion Models for Semantic 3D Brain MRI Synthesis
About
Artificial intelligence (AI) in healthcare, especially in medical imaging, faces challenges due to data scarcity and privacy concerns. Addressing these, we introduce Med-DDPM, a diffusion model designed for 3D semantic brain MRI synthesis. This model effectively tackles data scarcity and privacy issues by integrating semantic conditioning. This involves the channel-wise concatenation of a conditioning image to the model input, enabling control in image generation. Med-DDPM demonstrates superior stability and performance compared to existing 3D brain imaging synthesis methods. It generates diverse, anatomically coherent images with high visual fidelity. In terms of dice score accuracy in the tumor segmentation task, Med-DDPM achieves 0.6207, close to the 0.6531 accuracy of real images, and outperforms baseline models. Combined with real images, it further increases segmentation accuracy to 0.6675, showing the potential of our proposed method for data augmentation. This model represents the first use of a diffusion model in 3D semantic brain MRI synthesis, producing high-quality images. Its semantic conditioning feature also shows potential for image anonymization in biomedical imaging, addressing data and privacy issues. We provide the code and model weights for Med-DDPM on our GitHub repository (https://github.com/mobaidoctor/med-ddpm/) to support reproducibility.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Abdominal lymph node segmentation | ABD-LN (test) | DSC51.86 | 15 | |
| Video Generation | Paired Fundus CF-to-FFA (test) | FVD2.41e+3 | 10 | |
| 3D brain MRI generation | ADNI n=323 (test) | SSIM0.899 | 8 | |
| Medical Image Segmentation | BCV Decathlon Liver (test) | Dice Score (Clean)59.8 | 8 | |
| Medical Image Synthesis Faithfulness | CHAOS liver (CT) | Dice (Generated vs GT)51.2 | 8 | |
| Medical Volume Generation | CHAOS liver (CT) (test) | FID114.4 | 8 | |
| Image Segmentation | CHAOS liver (CT) (test) | Dice Score57.4 | 5 | |
| Image Segmentation | AVT aorta CT (test) | Dice Score56.1 | 5 | |
| Image Segmentation | Decathlon heart (MRI) (test) | Dice Coefficient41.2 | 5 | |
| Medical Image Synthesis | BraTS plus UCSF-PDGM, TCGA-GBM, TCGA-LGG, and Rembrandt cohorts 2021 (test) | Dice34.4 | 5 |