Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

NeuroMorph: Unsupervised Shape Interpolation and Correspondence in One Go

About

We present NeuroMorph, a new neural network architecture that takes as input two 3D shapes and produces in one go, i.e. in a single feed forward pass, a smooth interpolation and point-to-point correspondences between them. The interpolation, expressed as a deformation field, changes the pose of the source shape to resemble the target, but leaves the object identity unchanged. NeuroMorph uses an elegant architecture combining graph convolutions with global feature pooling to extract local features. During training, the model is incentivized to create realistic deformations by approximating geodesics on the underlying shape space manifold. This strong geometric prior allows to train our model end-to-end and in a fully unsupervised manner without requiring any manual correspondence annotations. NeuroMorph works well for a large variety of input shapes, including non-isometric pairs from different object categories. It obtains state-of-the-art results for both shape correspondence and interpolation tasks, matching or surpassing the performance of recent unsupervised and supervised methods on multiple benchmarks.

Marvin Eisenberger, David Novotny, Gael Kerchenbaum, Patrick Labatut, Natalia Neverova, Daniel Cremers, Andrea Vedaldi• 2021

Related benchmarks

TaskDatasetResultRank
Shape MatchingFAUST (test)
Mean Geodesic Error0.085
85
3D Shape CorrespondenceFAUST remeshed (test)
Mean Geodesic Error (x100)8.5
65
Shape MatchingSHREC'19 (test)
Mean Geodesic Error0.253
54
Shape CorrespondenceSCAPE (test)
Shape Correspondence Error0.273
54
Shape MatchingSCAPE remeshed (test)
Mean Geodesic Error (x100)29
46
Near-isometric point cloud matchingSCAPE_r remeshed (test)
Mean Geodesic Error0.29
25
Non-isometric 3D shape matchingSMAL
Mean Geodesic Error23.1
22
Near-isometric shape matchingFAUST (last 20 shapes)
Pointwise Geodesic Error8.5
16
Non-rigid shape matchingSCAPE
Mean Geodesic Error4
16
Near-isometric shape matchingSCAPE (final 20 shapes)
Pointwise Geodesic Error29.9
16
Showing 10 of 16 rows

Other info

Follow for update