From Feature Learning to Spectral Basis Learning: A Unifying and Flexible Framework for Efficient and Robust Shape Matching
About
Shape matching is a fundamental task in computer graphics and vision, with deep functional maps becoming a prominent paradigm. However, existing methods primarily focus on learning informative feature representations by constraining pointwise and functional maps, while neglecting the optimization of the spectral basis-a critical component of the functional map pipeline. This oversight often leads to suboptimal matching results. Furthermore, many current approaches rely on conventional, time-consuming functional map solvers, incurring significant computational overhead. To bridge these gaps, we introduce Advanced Functional Maps, a framework that generalizes standard functional maps by replacing fixed basis functions with learnable ones, supported by rigorous theoretical guarantees. Specifically, the spectral basis is optimized through a set of learned inhibition functions. Building on this, we propose the first unsupervised spectral basis learning method for robust non-rigid 3D shape matching, enabling the joint, end-to-end optimization of feature extraction and basis functions. Our approach incorporates a novel heat diffusion module and an unsupervised loss function, alongside a streamlined architecture that bypasses expensive solvers and auxiliary losses. Extensive experiments demonstrate that our method significantly outperforms state-of-the-art feature-learning approaches, particularly in challenging non-isometric and topological noise scenarios, while maintaining high efficiency. Finally, we reveal that optimizing basis functions is equivalent to spectral convolution, where inhibition functions act as filters. This insight enables enhanced representations inspired by spectral graph networks, opening new avenues for future research. Our code is available at https://github.com/LuoFeifan77/Unsupervised-Spectral-Basis-Learning.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Shape Matching | SHREC'19 | Geodesic Error (x100)5.9 | 45 | |
| Shape correspondence estimation | TOPKIDS | Geodesic Error (x100)5.9 | 44 | |
| 3D shape matching | FAUST Anisotropic (F_a) | Mean Geodesic Error2.1 | 35 | |
| 3D shape matching | SCAPE Anisotropic (S_a) | Mean Geodesic Error (x100)2.3 | 35 | |
| 3D shape matching | FAUST (F) | Mean Geodesic Error (x100)1.7 | 35 | |
| 3D shape matching | SCAPE S | Mean Geodesic Error (x100)2.3 | 35 | |
| 3D shape matching | DT4D-H inter-class | Mean Geodesic Error (x100)3.5 | 18 | |
| 3D shape matching | 3D Meshes 5K vertices | Average Inference Time (s)14.37 | 5 | |
| 3D shape matching | 3D Meshes 8K vertices | Average Inference Time (s)28.6 | 5 | |
| 3D shape matching | 3D Meshes 10K vertices | Average Inference Time (s)43.48 | 5 |