Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Hybrid Functional Maps for Crease-Aware Non-Isometric Shape Matching

About

Non-isometric shape correspondence remains a fundamental challenge in computer vision. Traditional methods using Laplace-Beltrami operator (LBO) eigenmodes face limitations in characterizing high-frequency extrinsic shape changes like bending and creases. We propose a novel approach of combining the non-orthogonal extrinsic basis of eigenfunctions of the elastic thin-shell hessian with the intrinsic ones of the LBO, creating a hybrid spectral space in which we construct functional maps. To this end, we present a theoretical framework to effectively integrate non-orthogonal basis functions into descriptor- and learning-based functional map methods. Our approach can be incorporated easily into existing functional map pipelines across varying applications and is able to handle complex deformations beyond isometries. We show extensive evaluations across various supervised and unsupervised settings and demonstrate significant improvements. Notably, our approach achieves up to 15% better mean geodesic error for non-isometric correspondence settings and up to 45% improvement in scenarios with topological noise.

Lennart Bastian, Yizheng Xie, Nassir Navab, Zorah L\"ahner• 2023

Related benchmarks

TaskDatasetResultRank
Shape MatchingFAUST (test)
Mean Geodesic Error0.015
85
Non-isometric 3D shape matchingSMAL
Mean Geodesic Error3.3
58
Shape MatchingSHREC'19
Geodesic Error (x100)3.6
45
Shape correspondence estimationTOPKIDS
Geodesic Error (x100)5
44
3D shape matchingFAUST (F)
Mean Geodesic Error (x100)1.4
35
3D shape matchingSCAPE S
Mean Geodesic Error (x100)1.8
35
3D shape matchingFAUST Anisotropic (F_a)
Mean Geodesic Error1.8
35
3D shape matchingSCAPE Anisotropic (S_a)
Mean Geodesic Error (x100)1.7
35
3D shape matchingSCAPE original (test)
Mean Geodesic Error (×100)1.8
34
3D shape matchingFAUST original (test)
Mean Geodesic Error (x100)1.4
34
Showing 10 of 32 rows

Other info

Code

Follow for update