Denoising Functional Maps: Diffusion Models for Shape Correspondence
About
Estimating correspondences between pairs of deformable shapes remains a challenging problem. Despite substantial progress, existing methods lack broad generalization capabilities and require category-specific training data. To address these limitations, we propose a fundamentally new approach to shape correspondence based on denoising diffusion models. In our method, a diffusion model learns to directly predict the functional map, a low-dimensional representation of a point-wise map between shapes. We use a large dataset of synthetic human meshes for training and employ two steps to reduce the number of functional maps that need to be learned. First, the maps refer to a template rather than shape pairs. Second, the functional map is defined in a basis of eigenvectors of the Laplacian, which is not unique due to sign ambiguity. Therefore, we introduce an unsupervised approach to select a specific basis by correcting the signs of eigenvectors based on surface features. Our model achieves competitive performance on standard human datasets, meshes with anisotropic connectivity, non-isometric humanoid shapes, as well as animals compared to existing descriptor-based and large-scale shape deformation methods. See our project page for the source code and the datasets.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Non-isometric 3D shape matching | SMAL | Mean Geodesic Error4.3 | 58 | |
| Shape correspondence estimation | TOPKIDS | Geodesic Error (x100)43.6 | 44 | |
| 3D shape matching | FAUST Anisotropic (F_a) | Mean Geodesic Error2 | 35 | |
| 3D shape matching | SCAPE Anisotropic (S_a) | Mean Geodesic Error (x100)2.3 | 35 | |
| 3D shape matching | SCAPE S | Mean Geodesic Error (x100)2.3 | 35 | |
| 3D shape matching | FAUST (F) | Mean Geodesic Error (x100)1.8 | 35 | |
| Shape Matching | DT4D-H inter-class (test) | Mean Geodesic Error (x100)5.8 | 24 | |
| 3D shape matching | DT4D-H inter-class | Mean Geodesic Error (x100)12.8 | 18 | |
| Non-isometric Shape Matching | DT4D-H intra | Geo.Err (x100)16.9 | 14 |