Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

LaserMix for Semi-Supervised LiDAR Semantic Segmentation

About

Densely annotating LiDAR point clouds is costly, which restrains the scalability of fully-supervised learning methods. In this work, we study the underexplored semi-supervised learning (SSL) in LiDAR segmentation. Our core idea is to leverage the strong spatial cues of LiDAR point clouds to better exploit unlabeled data. We propose LaserMix to mix laser beams from different LiDAR scans, and then encourage the model to make consistent and confident predictions before and after mixing. Our framework has three appealing properties: 1) Generic: LaserMix is agnostic to LiDAR representations (e.g., range view and voxel), and hence our SSL framework can be universally applied. 2) Statistically grounded: We provide a detailed analysis to theoretically explain the applicability of the proposed framework. 3) Effective: Comprehensive experimental analysis on popular LiDAR segmentation datasets (nuScenes, SemanticKITTI, and ScribbleKITTI) demonstrates our effectiveness and superiority. Notably, we achieve competitive results over fully-supervised counterparts with 2x to 5x fewer labels and improve the supervised-only baseline significantly by 10.8% on average. We hope this concise yet high-performing framework could facilitate future research in semi-supervised LiDAR segmentation. Code is publicly available.

Lingdong Kong, Jiawei Ren, Liang Pan, Ziwei Liu• 2022

Related benchmarks

TaskDatasetResultRank
LiDAR Semantic SegmentationnuScenes (val)
mIoU75.2
169
LiDAR Semantic SegmentationSemanticKITTI (val)
mIoU62.4
87
Semantic segmentationSemanticKITTI v1.0 (test)
mIoU62.3
71
3D Semantic SegmentationSemanticKITTI (val)
mIoU62.3
57
Semantic segmentationNuScenes v1.0 (test)
mIoU73.2
44
3D Semantic SegmentationnuScenes Lidar-Seg (val)
mIoU67.6
38
Semantic segmentationKITTI-360 (val)
mIoU62.3
36
LiDAR Semantic SegmentationScribbleKITTI (train)
mIoU56.8
34
Semantic segmentationsemanticKITTI SynLiDAR source (val)
mIoU (Mean IoU)36
33
LiDAR Semantic SegmentationSemanticKITTI (train)
mIoU62.3
30
Showing 10 of 31 rows

Other info

Code

Follow for update