PU-GCN: Point Cloud Upsampling using Graph Convolutional Networks
About
The effectiveness of learning-based point cloud upsampling pipelines heavily relies on the upsampling modules and feature extractors used therein. For the point upsampling module, we propose a novel model called NodeShuffle, which uses a Graph Convolutional Network (GCN) to better encode local point information from point neighborhoods. NodeShuffle is versatile and can be incorporated into any point cloud upsampling pipeline. Extensive experiments show how NodeShuffle consistently improves state-of-the-art upsampling methods. For feature extraction, we also propose a new multi-scale point feature extractor, called Inception DenseGCN. By aggregating features at multiple scales, this feature extractor enables further performance gain in the final upsampled point clouds. We combine Inception DenseGCN with NodeShuffle into a new point upsampling pipeline called PU-GCN. PU-GCN sets new state-of-art performance with much fewer parameters and more efficient inference.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Point Cloud Upsampling | PU-GAN Synthetic (test) | CD0.161 | 39 | |
| Point Cloud Upsampling | ShapeNet (test) | EMD4.94 | 32 | |
| Mesh Reconstruction | PU1K | ALR0.202 | 20 | |
| Point Cloud Upsampling | PU1K | CD1.241 | 20 | |
| Point Cloud Upsampling | PUGAN (test) | Chamfer Distance (CD)1.124 | 18 | |
| Point Cloud Classification | ShapeNet (test) | PointNet Instance Accuracy98.78 | 15 | |
| Point Cloud Upsampling | Sketchfab (test) | Size (Mb)1.8 | 14 | |
| Point Cloud Upsampling | PU1K (test) | CD (x10^-4)1.151 | 10 | |
| Point Cloud Upsampling | PUGAN 1.0 (test) | CD0.268 | 9 | |
| Point Cloud Upsampling | PU-GAN high-level random noise r=0.05 4x upsampling (test) | Chamfer Distance (CD)1.034 | 9 |