Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Boosting Medical Image Synthesis via Registration-guided Consistency and Disentanglement Learning

About

Medical image synthesis remains challenging due to misalignment noise during training. Existing methods have attempted to address this challenge by incorporating a registration-guided module. However, these methods tend to overlook the task-specific constraints on the synthetic and registration modules, which may cause the synthetic module to still generate spatially aligned images with misaligned target images during training, regardless of the registration module's function. Therefore, this paper proposes registration-guided consistency and incorporates disentanglement learning for medical image synthesis. The proposed registration-guided consistency architecture fosters task-specificity within the synthetic and registration modules by applying identical deformation fields before and after synthesis, while enforcing output consistency through an alignment loss. Moreover, the synthetic module is designed to possess the capability of disentangling anatomical structures and specific styles across various modalities. An anatomy consistency loss is introduced to further compel the synthetic module to preserve geometrical integrity within latent spaces. Experiments conducted on both an in-house abdominal CECT-CT dataset and a publicly available pelvic MR-CT dataset have demonstrated the superiority of the proposed method.

Chuanpu Li, Zeli Chen, Yiwen Zhang, Liming Zhong, Wei Yang• 2024

Related benchmarks

TaskDatasetResultRank
Medical Image SynthesisBraTS
SSIM88.45
108
CT to CBCT Image SynthesisSynthRAD Pelvis 2023
MAE31.51
12
Image SynthesisSynthRAD2023 Pelvis, CT to CBCT
PSNR26.36
12
CBCT to CT Image SynthesisSynthRAD Brain 2023
MAE21.3
12
Image SynthesisBraTS
Error T1->T25.12
12
Image SynthesisSynthRAD Brain, CBCT to CT 2023
PSNR34.21
12
Image SynthesisSynthRAD Pelvis CT to MRI 2023
PSNR31.23
12
CBCT to CT Image SynthesisSynthRAD Pelvis 2023
MAE20.01
12
CT to CBCT Image SynthesisSynthRAD2023 Brain
MAE35.99
12
CT to MRI Image SynthesisSynthRAD Brain 2023
MAE34.71
12
Showing 10 of 31 rows

Other info

Follow for update