G2P: Gaussian-to-Point Attribute Alignment for Boundary-Aware 3D Segmentation
About
Point cloud segmentation is critical for 3D scene understanding. However, sparse and irregular point distributions provide limited appearance evidence, making geometry-only features insufficient to distinguish objects with similar shapes but distinct appearances e.g., color, texture, and material. We propose Gaussian-to-Point (G2P), which transfers Gaussian attributes from 3D Gaussian Splatting to point clouds for more discriminative and appearance-consistent segmentation. Our G2P addresses the misalignment between optimized Gaussians and original point geometry by establishing point-wise correspondences. By distilling opacity-derived visibility cues, we mitigate the geometric ambiguity that limits existing models. Additionally, Gaussian scale attributes enable precise boundary localization in complex 3D scenes. Extensive experiments demonstrate that our approach achieves competitive performance on standard benchmarks and shows notable improvements on geometrically challenging classes, without pretrained 2D features or language supervision in our segmentation pipeline.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| 3D Semantic Segmentation | ScanNet V2 (val) | mIoU78.4 | 230 | |
| Semantic segmentation | ScanNet++ (val) | mIoU48.7 | 32 | |
| Semantic segmentation | ScanNet200 v2 (val) | mIoU36.6 | 27 | |
| Semantic segmentation | Matterport3D (val) | mIoU55.9 | 22 | |
| 3D Semantic Segmentation | ScanNet200 (test) | -- | 15 |