Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

LightM-UNet: Mamba Assists in Lightweight UNet for Medical Image Segmentation

About

UNet and its variants have been widely used in medical image segmentation. However, these models, especially those based on Transformer architectures, pose challenges due to their large number of parameters and computational loads, making them unsuitable for mobile health applications. Recently, State Space Models (SSMs), exemplified by Mamba, have emerged as competitive alternatives to CNN and Transformer architectures. Building upon this, we employ Mamba as a lightweight substitute for CNN and Transformer within UNet, aiming at tackling challenges stemming from computational resource limitations in real medical settings. To this end, we introduce the Lightweight Mamba UNet (LightM-UNet) that integrates Mamba and UNet in a lightweight framework. Specifically, LightM-UNet leverages the Residual Vision Mamba Layer in a pure Mamba fashion to extract deep semantic features and model long-range spatial dependencies, with linear computational complexity. Extensive experiments conducted on two real-world 2D/3D datasets demonstrate that LightM-UNet surpasses existing state-of-the-art literature. Notably, when compared to the renowned nnU-Net, LightM-UNet achieves superior segmentation performance while drastically reducing parameter and computation costs by 116x and 21x, respectively. This highlights the potential of Mamba in facilitating model lightweighting. Our code implementation is publicly available at https://github.com/MrBlankness/LightM-UNet.

Weibin Liao, Yinghao Zhu, Xinyuan Wang, Chengwei Pan, Yasha Wang, Liantao Ma• 2024

Related benchmarks

TaskDatasetResultRank
Medical Image SegmentationBUSI (test)
Dice83.34
228
Medical Image SegmentationISIC 2018--
187
Medical Image SegmentationISIC 2017--
102
Skin Lesion SegmentationISIC 2018
Dice Coefficient88.99
94
Skin Lesion SegmentationPH2
DIC0.8956
87
Skin Lesion SegmentationPH2 (test)
DSC92.11
70
2D skin lesion segmentationISIC 2017
mIoU81.49
60
Lesion SegmentationHAM10000
HD9512.52
38
Skin Lesion SegmentationHAM10000
Dice Coefficient93.93
34
Coronary artery segmentationImageCAS
DSC65.3
21
Showing 10 of 18 rows

Other info

Follow for update