Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

No Modality Left Behind: Adapting to Missing Modalities via Knowledge Distillation for Brain Tumor Segmentation

About

Accurate brain tumor segmentation is essential for preoperative evaluation and personalized treatment. Multi-modal MRI is widely used due to its ability to capture complementary tumor features across different sequences. However, in clinical practice, missing modalities are common, limiting the robustness and generalizability of existing deep learning methods that rely on complete inputs, especially under non-dominant modality combinations. To address this, we propose AdaMM, a multi-modal brain tumor segmentation framework tailored for missing-modality scenarios, centered on knowledge distillation and composed of three synergistic modules. The Graph-guided Adaptive Refinement Module explicitly models semantic associations between generalizable and modality-specific features, enhancing adaptability to modality absence. The Bi-Bottleneck Distillation Module transfers structural and textural knowledge from teacher to student models via global style matching and adversarial feature alignment. The Lesion-Presence-Guided Reliability Module predicts prior probabilities of lesion types through an auxiliary classification task, effectively suppressing false positives under incomplete inputs. Extensive experiments on the Pretreat-MetsToBrain-Masks and BraTS 2018, 2024 datasets demonstrate that AdaMM consistently outperforms existing methods, exhibiting superior segmentation accuracy and robustness, particularly in single-modality and weak-modality configurations. In addition, we conduct a systematic evaluation of six categories of missing-modality strategies, supporting the superiority of knowledge distillation and offering practical guidance for method selection and future research. Our source code is available at https://github.com/Quanato607/AdaMM.

Shenghao Zhu, Yifei Chen, Weihong Chen, Shuo Jiang, Guanyu Zhou, Yuanhan Wang, Feiwei Qin, Changmiao Wang, Qiyuan Tian• 2025

Related benchmarks

TaskDatasetResultRank
Enhancing Tumour SegmentationBraTS 2018 (test)
Dice Score63.75
95
Whole Tumor SegmentationPretreat-MetsToBrain-Masks
Mean Dice71.71
60
Enhancing Tumor SegmentationPretreat-MetsToBrain-Masks
Mean Dice68.48
45
Tumor Core SegmentationPretreat-MetsToBrain-Masks
Dice (Mean)0.7665
45
Enhancing Tumor (ET) SegmentationBraTS 2024
Average Performance Score63.54
40
Whole Tumor SegmentationBraTS 2018 (test)
DSC Average86.94
37
Brain Tumor SegmentationBraTS Whole Tumor (WT) 2024
Average Sensitivity (WT)86.16
20
Brain Tumor Segmentation (ET)BraTS 2018
IoU (%)67.47
20
Brain Tumor Segmentation (TC)BraTS 2018
IoU78.41
20
Brain Tumor Segmentation (WT)BraTS 2018
IoU81.43
20
Showing 10 of 26 rows

Other info

Follow for update