Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Hybrid Functional Maps for Crease-Aware Non-Isometric Shape Matching

About

Non-isometric shape correspondence remains a fundamental challenge in computer vision. Traditional methods using Laplace-Beltrami operator (LBO) eigenmodes face limitations in characterizing high-frequency extrinsic shape changes like bending and creases. We propose a novel approach of combining the non-orthogonal extrinsic basis of eigenfunctions of the elastic thin-shell hessian with the intrinsic ones of the LBO, creating a hybrid spectral space in which we construct functional maps. To this end, we present a theoretical framework to effectively integrate non-orthogonal basis functions into descriptor- and learning-based functional map methods. Our approach can be incorporated easily into existing functional map pipelines across varying applications and is able to handle complex deformations beyond isometries. We show extensive evaluations across various supervised and unsupervised settings and demonstrate significant improvements. Notably, our approach achieves up to 15% better mean geodesic error for non-isometric correspondence settings and up to 45% improvement in scenarios with topological noise.

Lennart Bastian, Yizheng Xie, Nassir Navab, Zorah L\"ahner• 2023

Related benchmarks

TaskDatasetResultRank
Shape MatchingFAUST (test)
Mean Geodesic Error0.015
85
Shape correspondence estimationTOPKIDS
Geodesic Error (x100)5
19
Shape correspondence estimationFaust
Geodesic Error (Scaled)1.5
14
Shape correspondence estimationSCAPE
Geodesic Error (x100)1.8
14
Shape correspondence estimationSMAL
Geodesic Error (x100)3.3
14
Shape correspondence estimationDT4D inter-class II
Geodesic Error0.035
14
Shape correspondence estimationDT4D-II intra-class
Geodesic Error0.01
14
Shape MatchingSHREC'19
Geodesic Error (x100)3.6
9
Shape MatchingSCAPE (test)
Mean Geodesic Error1.8
6
Showing 9 of 9 rows

Other info

Code

Follow for update