Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

ComPC: Completing a 3D Point Cloud with 2D Diffusion Priors

About

3D point clouds directly collected from objects through sensors are often incomplete due to self-occlusion. Conventional methods for completing these partial point clouds rely on manually organized training sets and are usually limited to object categories seen during training. In this work, we propose a test-time framework for completing partial point clouds across unseen categories without any requirement for training. Leveraging point rendering via Gaussian Splatting, we develop techniques of Partial Gaussian Initialization, Zero-shot Fractal Completion, and Point Cloud Extraction that utilize priors from pre-trained 2D diffusion models to infer missing regions and extract uniform completed point clouds. Experimental results on both synthetic and real-world scanned point clouds demonstrate that our approach outperforms existing methods in completing a variety of objects. Our project page is at \url{https://tianxinhuang.github.io/projects/ComPC/}.

Tianxin Huang, Zhiwen Yan, Yuyang Zhao, Gim Hee Lee• 2024

Related benchmarks

TaskDatasetResultRank
3D Shape CompletionSynthetic data (test)
Chamfer Distance (CD)1.61
19
3D Shape CompletionRedwood
CD1.95
10
Shape completionScanNet Chair real scans
UCD2
10
3D Shape CompletionKITTI-Car 15 (test)
UCD1.1
7
3D Shape CompletionOmni-Comp Single Scan
CD4.24
7
3D Shape CompletionScanNet Table 10 (test)
UCD3
7
3D Shape CompletionOmni-Comp Random Crop
CD5.48
7
3D Shape CompletionOmni-Comp Semantic Part
CD6.37
7
3D Shape CompletionSynthetic 25, 37
MMD1.65
4
3D Shape CompletionRedwood 5
MMD2.01
4
Showing 10 of 10 rows

Other info

Follow for update