Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Contrastive Boundary Learning for Point Cloud Segmentation

About

Point cloud segmentation is fundamental in understanding 3D environments. However, current 3D point cloud segmentation methods usually perform poorly on scene boundaries, which degenerates the overall segmentation performance. In this paper, we focus on the segmentation of scene boundaries. Accordingly, we first explore metrics to evaluate the segmentation performance on scene boundaries. To address the unsatisfactory performance on boundaries, we then propose a novel contrastive boundary learning (CBL) framework for point cloud segmentation. Specifically, the proposed CBL enhances feature discrimination between points across boundaries by contrasting their representations with the assistance of scene contexts at multiple scales. By applying CBL on three different baseline methods, we experimentally show that CBL consistently improves different baselines and assists them to achieve compelling performance on boundaries, as well as the overall performance, eg in mIoU. The experimental results demonstrate the effectiveness of our method and the importance of boundaries for 3D point cloud segmentation. Code and model will be made publicly available at https://github.com/LiyaoTang/contrastBoundary.

Liyao Tang, Yibing Zhan, Zhe Chen, Baosheng Yu, Dacheng Tao• 2022

Related benchmarks

TaskDatasetResultRank
Semantic segmentationS3DIS (Area 5)
mIOU71
799
Semantic segmentationS3DIS (6-fold)
mIoU (Mean IoU)73.1
315
Semantic segmentationScanNet v2 (test)
mIoU70.5
248
3D Semantic SegmentationScanNet V2 (val)
mIoU70.5
171
3D Semantic SegmentationScanNet v2 (test)
mIoU70.5
110
3D Semantic SegmentationScanNet (val)
mIoU71.33
100
3D Semantic SegmentationScanNet v1 (test)--
72
Semantic segmentationSemantic3D (reduced-8)
mIoU78.4
30
Point Cloud Semantic SegmentationNPM3D (test)
mIoU78.6
17
Semantic segmentationS3DIS (Stanford Indoor Dataset)
mIoU71.6
10
Showing 10 of 10 rows

Other info

Code

Follow for update