Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Point Cloud Semantic Segmentation with Sparse and Inhomogeneous Annotations

About

Utilizing uniformly distributed sparse annotations, weakly supervised learning alleviates the heavy reliance on fine-grained annotations in point cloud semantic segmentation tasks. However, few works discuss the inhomogeneity of sparse annotations, albeit it is common in real-world scenarios. Therefore, this work introduces the probability density function into the gradient sampling approximation method to qualitatively analyze the impact of annotation sparsity and inhomogeneity under weakly supervised learning. Based on our analysis, we propose an Adaptive Annotation Distribution Network (AADNet) capable of robust learning on arbitrarily distributed sparse annotations. Specifically, we propose a label-aware point cloud downsampling strategy to increase the proportion of annotations involved in the training stage. Furthermore, we design the multiplicative dynamic entropy as the gradient calibration function to mitigate the gradient bias caused by non-uniformly distributed sparse annotations and explicitly reduce the epistemic uncertainty. Without any prior restrictions and additional information, our proposed method achieves comprehensive performance improvements at multiple label rates and different annotation distributions.

Zhiyi Pan, Nan Zhang, Wei Gao, Shan Liu, Ge Li• 2023

Related benchmarks

TaskDatasetResultRank
Semantic segmentationS3DIS (Area 5)
mIOU67.2
907
Semantic segmentationScanNet V2
mIoU66.8
54
3D Semantic SegmentationS3DIS
mIoU63.4
27
Semantic segmentationToronto-3D
Mean IoU (mIoU)63.1
24
3D Semantic SegmentationScanNet
mIoU52.8
7
3D Semantic SegmentationSemantic3D
mIoU48.1
7
Showing 6 of 6 rows

Other info

Follow for update