Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

CaDeX: Learning Canonical Deformation Coordinate Space for Dynamic Surface Representation via Neural Homeomorphism

About

While neural representations for static 3D shapes are widely studied, representations for deformable surfaces are limited to be template-dependent or lack efficiency. We introduce Canonical Deformation Coordinate Space (CaDeX), a unified representation of both shape and nonrigid motion. Our key insight is the factorization of the deformation between frames by continuous bijective canonical maps (homeomorphisms) and their inverses that go through a learned canonical shape. Our novel deformation representation and its implementation are simple, efficient, and guarantee cycle consistency, topology preservation, and, if needed, volume conservation. Our modelling of the learned canonical shapes provides a flexible and stable space for shape prior learning. We demonstrate state-of-the-art performance in modelling a wide range of deformable geometries: human bodies, animal bodies, and articulated objects.

Jiahui Lei, Kostas Daniilidis• 2022

Related benchmarks

TaskDatasetResultRank
Dynamic Human Body ModelingD-FAUST 5 (Seen Individual)
Chamfer Distance0.039
18
Dynamic Human Body ModelingD-FAUST 5 (Unseen Individual)
IoU8.07e+3
12
4D Shape CompletionDT4D-A (Unseen Motion)
IoU80.3
8
4D Shape CompletionD-FAUST (Unseen Motion)
IoU89.1
8
4D Shape CompletionD-FAUST (unseen individual)
IoU80.7
8
4D Shape CompletionDT4D-A (Unseen Individual)
IoU64.7
8
Articulated Object ModelingShape2Motion (test)
IoU58.9
6
Dynamic Animal Body ModelingDeformingThings4D (Seen individual)
IoU80.3
6
Dynamic Animal Body ModelingDeformingThings4D (Unseen individual)
IoU64.7
6
Dynamic Human Body ModelingD-FAUST (unseen individual)
Chamfer Distance (CD)0.055
6
Showing 10 of 11 rows

Other info

Code

Follow for update