Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

PointMamba: A Simple State Space Model for Point Cloud Analysis

About

Transformers have become one of the foundational architectures in point cloud analysis tasks due to their excellent global modeling ability. However, the attention mechanism has quadratic complexity, making the design of a linear complexity method with global modeling appealing. In this paper, we propose PointMamba, transferring the success of Mamba, a recent representative state space model (SSM), from NLP to point cloud analysis tasks. Unlike traditional Transformers, PointMamba employs a linear complexity algorithm, presenting global modeling capacity while significantly reducing computational costs. Specifically, our method leverages space-filling curves for effective point tokenization and adopts an extremely simple, non-hierarchical Mamba encoder as the backbone. Comprehensive evaluations demonstrate that PointMamba achieves superior performance across multiple datasets while significantly reducing GPU memory usage and FLOPs. This work underscores the potential of SSMs in 3D vision-related tasks and presents a simple yet effective Mamba-based baseline for future research. The code will be made available at \url{https://github.com/LMD0311/PointMamba}.

Dingkang Liang, Xin Zhou, Wei Xu, Xingkui Zhu, Zhikang Zou, Xiaoqing Ye, Xiao Tan, Xiang Bai• 2024

Related benchmarks

TaskDatasetResultRank
Part SegmentationShapeNetPart (test)
mIoU (Inst.)86.2
312
Object ClassificationScanObjectNN OBJ_BG
Accuracy94.32
215
Part SegmentationShapeNetPart
mIoU (Instance)86
198
Object ClassificationScanObjectNN PB_T50_RS
Accuracy89.31
195
Object ClassificationScanObjectNN OBJ_ONLY
Overall Accuracy92.6
166
Few-shot 3D ClassificationModelNet40 (test)
Accuracy97.3
92
Few-shot classificationModelNet40 10-way 10-shot
Accuracy91.4
79
Few-shot classificationModelNet40 5-way 20-shot
Accuracy97.3
79
Few-shot classificationModelNet40 5-way 10-shot
Accuracy95
79
Few-shot classificationModelNet40 10-way 20-shot
Accuracy92.8
79
Showing 10 of 24 rows

Other info

Follow for update