Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

3D Shape Completion on Unseen Categories:A Weakly-supervised Approach

About

3D shapes captured by scanning devices are often incomplete due to occlusion. 3D shape completion methods have been explored to tackle this limitation. However, most of these methods are only trained and tested on a subset of categories, resulting in poor generalization to unseen categories. In this paper, we introduce a novel weakly-supervised framework to reconstruct the complete shapes from unseen categories. We first propose an end-to-end prior-assisted shape learning network that leverages data from the seen categories to infer a coarse shape. Specifically, we construct a prior bank consisting of representative shapes from the seen categories. Then, we design a multi-scale pattern correlation module for learning the complete shape of the input by analyzing the correlation between local patterns within the input and the priors at various scales. In addition, we propose a self-supervised shape refinement model to further refine the coarse shape. Considering the shape variability of 3D objects across categories, we construct a category-specific prior bank to facilitate shape refinement. Then, we devise a voxel-based partial matching loss and leverage the partial scans to drive the refinement process. Extensive experimental results show that our approach is superior to state-of-the-art methods by a large margin.

Lintai Wu, Junhui Hou, Linqi Song, Yong Xu• 2024

Related benchmarks

TaskDatasetResultRank
Refining VFM-derived artifactsToys4k
mIoU35.8
13
Refining VFM-derived artifactsDora
mIoU33.19
13
Refinement of VFM-derived artifactsToys4k (synthetically corrupted)
mIoU0.0036
8
Showing 3 of 3 rows

Other info

Follow for update