Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Unsupervised Deep Learning for Structured Shape Matching

About

We present a novel method for computing correspondences across 3D shapes using unsupervised learning. Our method computes a non-linear transformation of given descriptor functions, while optimizing for global structural properties of the resulting maps, such as their bijectivity or approximate isometry. To this end, we use the functional maps framework, and build upon the recent FMNet architecture for descriptor learning. Unlike that approach, however, we show that learning can be done in a purely \emph{unsupervised setting}, without having access to any ground truth correspondences. This results in a very general shape matching method that we call SURFMNet for Spectral Unsupervised FMNet, and which can be used to establish correspondences within 3D shape collections without any prior information. We demonstrate on a wide range of challenging benchmarks, that our approach leads to state-of-the-art results compared to the existing unsupervised methods and achieves results that are comparable even to the supervised learning techniques. Moreover, our framework is an order of magnitude faster, and does not rely on geodesic distance computation or expensive post-processing.

Jean-Michel Roufosse, Abhishek Sharma, Maks Ovsjanikov• 2018

Related benchmarks

TaskDatasetResultRank
Shape MatchingFAUST (test)
Mean Geodesic Error0.15
85
3D Shape CorrespondenceFAUST remeshed (test)
Mean Geodesic Error (x100)2.5
65
Shape CorrespondenceSCAPE (test)
Shape Correspondence Error0.061
54
Shape MatchingSCAPE remeshed (test)
Mean Geodesic Error (x100)6
46
Shape MatchingSHREC19 remeshed (test)
Mean Geodesic Error0.048
37
Near-isometric shape matchingSCAPE (test)
Mean Geodesic Error12
32
Near-isometric point cloud matchingSCAPE_r remeshed (test)
Mean Geodesic Error0.12
25
Shape correspondence estimationTOPKIDS
Geodesic Error (x100)48.6
19
Near-isometric shape matchingSCAPE (final 20 shapes)
Pointwise Geodesic Error12
16
Shape CorrespondenceSurreal (test)
Accuracy4.3
16
Showing 10 of 24 rows

Other info

Follow for update