Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Distribution Guidance Network for Weakly Supervised Point Cloud Semantic Segmentation

About

Despite alleviating the dependence on dense annotations inherent to fully supervised methods, weakly supervised point cloud semantic segmentation suffers from inadequate supervision signals. In response to this challenge, we introduce a novel perspective that imparts auxiliary constraints by regulating the feature space under weak supervision. Our initial investigation identifies which distributions accurately characterize the feature space, subsequently leveraging this priori to guide the alignment of the weakly supervised embeddings. Specifically, we analyze the superiority of the mixture of von Mises-Fisher distributions (moVMF) among several common distribution candidates. Accordingly, we develop a Distribution Guidance Network (DGNet), which comprises a weakly supervised learning branch and a distribution alignment branch. Leveraging reliable clustering initialization derived from the weakly supervised learning branch, the distribution alignment branch alternately updates the parameters of the moVMF and the network, ensuring alignment with the moVMF-defined latent space. Extensive experiments validate the rationality and effectiveness of our distribution choice and network design. Consequently, DGNet achieves state-of-the-art performance under multiple datasets and various weakly supervised settings.

Zhiyi Pan, Wei Gao, Shan Liu, Ge Li• 2024

Related benchmarks

TaskDatasetResultRank
Semantic segmentationS3DIS (Area 5)
mIOU67.8
907
Semantic segmentationScanNet V2
mIoU67.4
54
Semantic segmentationSemanticKITTI v1.0 (val)
mIoU51.8
30
3D Semantic SegmentationS3DIS
mIoU63.4
27
Semantic segmentationToronto-3D
Mean IoU (mIoU)62.7
24
3D Semantic SegmentationScanNet
mIoU52.9
7
3D Semantic SegmentationSemantic3D
mIoU48.4
7
Showing 7 of 7 rows

Other info

Follow for update