ComPC: Completing a 3D Point Cloud with 2D Diffusion Priors
About
3D point clouds directly collected from objects through sensors are often incomplete due to self-occlusion. Conventional methods for completing these partial point clouds rely on manually organized training sets and are usually limited to object categories seen during training. In this work, we propose a test-time framework for completing partial point clouds across unseen categories without any requirement for training. Leveraging point rendering via Gaussian Splatting, we develop techniques of Partial Gaussian Initialization, Zero-shot Fractal Completion, and Point Cloud Extraction that utilize priors from pre-trained 2D diffusion models to infer missing regions and extract uniform completed point clouds. Experimental results on both synthetic and real-world scanned point clouds demonstrate that our approach outperforms existing methods in completing a variety of objects. Our project page is at \url{https://tianxinhuang.github.io/projects/ComPC/}.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| 3D Shape Completion | Synthetic data (test) | Chamfer Distance (CD)1.61 | 19 | |
| 3D Shape Completion | Redwood | CD1.95 | 10 | |
| Shape completion | ScanNet Chair real scans | UCD2 | 10 | |
| 3D Shape Completion | KITTI-Car 15 (test) | UCD1.1 | 7 | |
| 3D Shape Completion | Omni-Comp Single Scan | CD4.24 | 7 | |
| 3D Shape Completion | ScanNet Table 10 (test) | UCD3 | 7 | |
| 3D Shape Completion | Omni-Comp Random Crop | CD5.48 | 7 | |
| 3D Shape Completion | Omni-Comp Semantic Part | CD6.37 | 7 | |
| 3D Shape Completion | Synthetic 25, 37 | MMD1.65 | 4 | |
| 3D Shape Completion | Redwood 5 | MMD2.01 | 4 |