Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

CoSMix: Compositional Semantic Mix for Domain Adaptation in 3D LiDAR Segmentation

About

3D LiDAR semantic segmentation is fundamental for autonomous driving. Several Unsupervised Domain Adaptation (UDA) methods for point cloud data have been recently proposed to improve model generalization for different sensors and environments. Researchers working on UDA problems in the image domain have shown that sample mixing can mitigate domain shift. We propose a new approach of sample mixing for point cloud UDA, namely Compositional Semantic Mix (CoSMix), the first UDA approach for point cloud segmentation based on sample mixing. CoSMix consists of a two-branch symmetric network that can process labelled synthetic data (source) and real-world unlabelled point clouds (target) concurrently. Each branch operates on one domain by mixing selected pieces of data from the other one, and by using the semantic information derived from source labels and target pseudo-labels. We evaluate CoSMix on two large-scale datasets, showing that it outperforms state-of-the-art methods by a large margin. Our code is available at https://github.com/saltoricristiano/cosmix-uda.

Cristiano Saltori, Fabio Galasso, Giuseppe Fiameni, Nicu Sebe, Elisa Ricci, Fabio Poiesi• 2022

Related benchmarks

TaskDatasetResultRank
Semantic segmentationsemanticKITTI SynLiDAR source (val)
mIoU (Mean IoU)29.9
21
3D Semantic SegmentationSemanticPOSS SemanticKITTI source target 13 classes (val)
mIoU40.8
13
3D Semantic SegmentationSemanticPOSS nuScenes source 6 classes (val)
mIoU65.2
13
3D Semantic SegmentationSemanticKITTI source target 19 classes (val)
mIoU28
13
3D Semantic SegmentationSemanticKITTI nuScenes source 10 classes (val)
mIoU38.3
13
3D Semantic SegmentationSynLiDAR -> semanticPOSS (test)
mIoU44.6
12
LiDAR Semantic SegmentationParis-Lille-3D
Ground IoU95.29
6
LiDAR Semantic SegmentationISPRS Vaihingen
Ground IoU0.8273
6
Semantic segmentationSTPLS3D to DALES (test)
Ground IoU93.36
6
3D Semantic SegmentationSemanticSTF Entire (all four weather conditions) 1.0
Car IoU65
6
Showing 10 of 13 rows

Other info

Follow for update