Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Neural Intrinsic Embedding for Non-rigid Point Cloud Matching

About

As a primitive 3D data representation, point clouds are prevailing in 3D sensing, yet short of intrinsic structural information of the underlying objects. Such discrepancy poses great challenges on directly establishing correspondences between point clouds sampled from deformable shapes. In light of this, we propose Neural Intrinsic Embedding (NIE) to embed each vertex into a high-dimensional space in a way that respects the intrinsic structure. Based upon NIE, we further present a weakly-supervised learning framework for non-rigid point cloud registration. Unlike the prior works, we do not require expansive and sensitive off-line basis construction (e.g., eigen-decomposition of Laplacians), nor do we require ground-truth correspondence labels for supervision. We empirically show that our framework performs on par with or even better than the state-of-the-art baselines, which generally require more supervision and/or more structural geometric input.

Puhua Jiang, Mingze Sun, Ruqi Huang• 2023

Related benchmarks

TaskDatasetResultRank
3D Shape CorrespondenceFAUST remeshed (test)
Mean Geodesic Error (x100)5.5
65
Near-isometric point cloud matchingSCAPE_r remeshed (test)
Mean Geodesic Error0.1
25
Embedding EvaluationSCAPE_r (test)
OPT3.1
6
Partial Shape MatchingPoint Clouds half (test)
Mean Geodesic Error0.1
2
Partial Shape MatchingPoint Clouds hole (test)
Mean Geodesic Error0.07
2
Partial Shape MatchingPoint Clouds cut (test)
Mean Geodesic Error0.072
2
Showing 6 of 6 rows

Other info

Follow for update