Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Mamba-UNet: UNet-Like Pure Visual Mamba for Medical Image Segmentation

About

In recent advancements in medical image analysis, Convolutional Neural Networks (CNN) and Vision Transformers (ViT) have set significant benchmarks. While the former excels in capturing local features through its convolution operations, the latter achieves remarkable global context understanding by leveraging self-attention mechanisms. However, both architectures exhibit limitations in efficiently modeling long-range dependencies within medical images, which is a critical aspect for precise segmentation. Inspired by the Mamba architecture, known for its proficiency in handling long sequences and global contextual information with enhanced computational efficiency as a State Space Model (SSM), we propose Mamba-UNet, a novel architecture that synergizes the U-Net in medical image segmentation with Mamba's capability. Mamba-UNet adopts a pure Visual Mamba (VMamba)-based encoder-decoder structure, infused with skip connections to preserve spatial information across different scales of the network. This design facilitates a comprehensive feature learning process, capturing intricate details and broader semantic contexts within medical images. We introduce a novel integration mechanism within the VMamba blocks to ensure seamless connectivity and information flow between the encoder and decoder paths, enhancing the segmentation performance. We conducted experiments on publicly available ACDC MRI Cardiac segmentation dataset, and Synapse CT Abdomen segmentation dataset. The results show that Mamba-UNet outperforms several types of UNet in medical image segmentation under the same hyper-parameter setting. The source code and baseline implementations are available.

Ziyang Wang, Jian-Qing Zheng, Yichi Zhang, Ge Cui, Lei Li• 2024

Related benchmarks

TaskDatasetResultRank
Medical Image SegmentationISIC 2018
Dice Score87.04
139
Medical Image SegmentationSynapse (test)
Dice73.36
123
Medical Image SegmentationISIC 2017
Dice Score84.56
74
Medical Image SegmentationACDC
DSC (Avg)89.11
65
Medical Image SegmentationGLAS
Dice93.41
60
Abdominal multi-organ segmentationBTCV
Spleen84.03
58
Brain Tumor SegmentationBraTS 2023 (test)
WT Dice91.03
49
Abdominal multi-organ segmentationSynapse
Average DSC76.21
29
Brain Tumor SegmentationMSD (test)
HD95 (WT)1.3459
24
Medical Image SegmentationMoNuSeg
Dice76.54
17
Showing 10 of 17 rows

Other info

Follow for update