Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Conditional Diffusion Models for Semantic 3D Brain MRI Synthesis

About

Artificial intelligence (AI) in healthcare, especially in medical imaging, faces challenges due to data scarcity and privacy concerns. Addressing these, we introduce Med-DDPM, a diffusion model designed for 3D semantic brain MRI synthesis. This model effectively tackles data scarcity and privacy issues by integrating semantic conditioning. This involves the channel-wise concatenation of a conditioning image to the model input, enabling control in image generation. Med-DDPM demonstrates superior stability and performance compared to existing 3D brain imaging synthesis methods. It generates diverse, anatomically coherent images with high visual fidelity. In terms of dice score accuracy in the tumor segmentation task, Med-DDPM achieves 0.6207, close to the 0.6531 accuracy of real images, and outperforms baseline models. Combined with real images, it further increases segmentation accuracy to 0.6675, showing the potential of our proposed method for data augmentation. This model represents the first use of a diffusion model in 3D semantic brain MRI synthesis, producing high-quality images. Its semantic conditioning feature also shows potential for image anonymization in biomedical imaging, addressing data and privacy issues. We provide the code and model weights for Med-DDPM on our GitHub repository (https://github.com/mobaidoctor/med-ddpm/) to support reproducibility.

Zolnamar Dorjsembe, Hsing-Kuo Pao, Sodtavilan Odonchimed, Furen Xiao• 2023

Related benchmarks

TaskDatasetResultRank
Abdominal lymph node segmentationABD-LN (test)
DSC51.86
15
Video GenerationPaired Fundus CF-to-FFA (test)
FVD2.41e+3
10
3D brain MRI generationADNI n=323 (test)
SSIM0.899
8
Medical Image SegmentationBCV Decathlon Liver (test)
Dice Score (Clean)59.8
8
Medical Image Synthesis FaithfulnessCHAOS liver (CT)
Dice (Generated vs GT)51.2
8
Medical Volume GenerationCHAOS liver (CT) (test)
FID114.4
8
Image SegmentationCHAOS liver (CT) (test)
Dice Score57.4
5
Image SegmentationAVT aorta CT (test)
Dice Score56.1
5
Image SegmentationDecathlon heart (MRI) (test)
Dice Coefficient41.2
5
Medical Image SynthesisBraTS plus UCSF-PDGM, TCGA-GBM, TCGA-LGG, and Rembrandt cohorts 2021 (test)
Dice34.4
5
Showing 10 of 19 rows

Other info

Follow for update