Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

ProxyFormer: Proxy Alignment Assisted Point Cloud Completion with Missing Part Sensitive Transformer

About

Problems such as equipment defects or limited viewpoints will lead the captured point clouds to be incomplete. Therefore, recovering the complete point clouds from the partial ones plays an vital role in many practical tasks, and one of the keys lies in the prediction of the missing part. In this paper, we propose a novel point cloud completion approach namely ProxyFormer that divides point clouds into existing (input) and missing (to be predicted) parts and each part communicates information through its proxies. Specifically, we fuse information into point proxy via feature and position extractor, and generate features for missing point proxies from the features of existing point proxies. Then, in order to better perceive the position of missing points, we design a missing part sensitive transformer, which converts random normal distribution into reasonable position information, and uses proxy alignment to refine the missing proxies. It makes the predicted point proxies more sensitive to the features and positions of the missing part, and thus make these proxies more suitable for subsequent coarse-to-fine processes. Experimental results show that our method outperforms state-of-the-art completion networks on several benchmark datasets and has the fastest inference speed. Code is available at https://github.com/I2-Multimedia-Lab/ProxyFormer.

Shanshan Li, Pan Gao, Xiaoyang Tan, Mingqiang Wei• 2023

Related benchmarks

TaskDatasetResultRank
Point Cloud CompletionPCN (test)
Watercraft5.98
60
Point Cloud CompletionShapeNet-34 (seen categories)
Chamfer Distance (S)0.44
50
Point Cloud CompletionShapeNet-55 (test)
CD-M0.75
44
Point Cloud CompletionKITTI
MMD0.508
42
Point Cloud CompletionShapeNet-34 unseen categories
CD (Symmetric)0.6
37
Point Cloud CompletionPCN
CD6.77
23
Tooth crown generationTooth point cloud dataset 1 missing tooth 1.0
Chamfer Distance (L1)39.98
7
Shape completionBuilding3D
CD L23.75
7
Shape completionBuilding-PCC
CD (L2)3.29
7
Tooth crown generationTooth point cloud dataset 2 missing teeth 1.0
Chamfer Distance L152.825
7
Showing 10 of 14 rows

Other info

Code

Follow for update