FUSE: A Flow-based Mapping Between Shapes
About
We introduce a novel neural representation for maps between 3D shapes based on flow-matching models, which is computationally efficient and supports cross-representation shape matching without large-scale training or data-driven procedures. 3D shapes are represented as the probability distribution induced by a continuous and invertible flow mapping from a fixed anchor distribution. Given a source and a target shape, the composition of the inverse flow (source to anchor) with the forward flow (anchor to target), we map points between the two surfaces. By encoding the shapes with a pointwise task-tailored embedding, this construction provides an invertible and modality-agnostic representation of maps between shapes across point clouds, meshes, signed distance fields (SDFs), and volumetric data. The resulting representation consistently achieves high coverage and accuracy across diverse benchmarks and challenging settings in shape matching. Beyond shape matching, our framework shows promising results in other tasks, including UV mapping and registration of raw point cloud scans of human bodies.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Shape Matching | FAUST (test) | Mean Geodesic Error0.028 | 88 | |
| Shape Correspondence | SHREC strong non-iso 20 | Euclidean Distance0.0658 | 15 | |
| Shape Correspondence | FAUST quasi-iso | Euclidean Error0.0179 | 15 | |
| Shape Correspondence | SMAL non-iso | Euclidean Error0.0422 | 15 | |
| Shape Correspondence | Kinect point cloud | Euclidean Error0.069 | 14 | |
| Mesh to SDF Shape Matching | Inter-representation Shape Matching | Euclidean Distance0.0358 | 10 | |
| Volumetric shape correspondence | Non-isometric tetrahedral meshes | Accuracy9.42 | 10 | |
| Mesh to PointCloud Shape Matching | Inter-representation Shape Matching | Euclidean Error0.0695 | 10 | |
| PointCloud to SDF Shape Matching | Inter-representation Shape Matching | Euclidean Error0.073 | 10 | |
| Shape Matching | SMAL (test) | Mean Geodesic Error0.059 | 10 |