Detail Preserved Point Cloud Completion via Separated Feature Aggregation
About
Point cloud shape completion is a challenging problem in 3D vision and robotics. Existing learning-based frameworks leverage encoder-decoder architectures to recover the complete shape from a highly encoded global feature vector. Though the global feature can approximately represent the overall shape of 3D objects, it would lead to the loss of shape details during the completion process. In this work, instead of using a global feature to recover the whole complete surface, we explore the functionality of multi-level features and aggregate different features to represent the known part and the missing part separately. We propose two different feature aggregation strategies, named global \& local feature aggregation(GLFA) and residual feature aggregation(RFA), to express the two kinds of features and reconstruct coordinates from their combination. In addition, we also design a refinement component to prevent the generated point cloud from non-uniform distribution and outliers. Extensive experiments have been conducted on the ShapeNet dataset. Qualitative and quantitative evaluations demonstrate that our proposed network outperforms current state-of-the art methods especially on detail preservation.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Point Cloud Completion | PCN (test) | Watercraft7.48 | 60 | |
| Point Cloud Completion | KITTI | MMD0.891 | 42 | |
| Point Cloud Completion | KITTI (test) | MMD0.891 | 33 | |
| Point Cloud Completion | ShapeNet seen categories | Airplane Error4.76 | 32 | |
| Shape completion | multi-view partial (MVP) 16,384 points (test) | airplane90.3 | 8 | |
| Point Cloud Completion | ScanNet Chair | Mean Preference Score1.73 | 3 | |
| Point Cloud Completion | ScanNet Table | Mean Preference Score2.2 | 3 | |
| Point Cloud Completion | ShapeNet Known Categories | Airplane26.747 | 3 | |
| Point Cloud Completion | KITTI Car | Mean Preference Score1.07 | 3 | |
| Point Cloud Completion | Real Scans | Mean Preference Score1.67 | 3 |