Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Skeleton-free Pose Transfer for Stylized 3D Characters

About

We present the first method that automatically transfers poses between stylized 3D characters without skeletal rigging. In contrast to previous attempts to learn pose transformations on fixed or topology-equivalent skeleton templates, our method focuses on a novel scenario to handle skeleton-free characters with diverse shapes, topologies, and mesh connectivities. The key idea of our method is to represent the characters in a unified articulation model so that the pose can be transferred through the correspondent parts. To achieve this, we propose a novel pose transfer network that predicts the character skinning weights and deformation transformations jointly to articulate the target character to match the desired pose. Our method is trained in a semi-supervised manner absorbing all existing character data with paired/unpaired poses and stylized shapes. It generalizes well to unseen stylized characters and inanimate objects. We conduct extensive experiments and demonstrate the effectiveness of our method on this novel task.

Zhouyingcheng Liao, Jimei Yang, Jun Saito, Gerard Pons-Moll, Yang Zhou• 2022

Related benchmarks

TaskDatasetResultRank
3D Pose TransferPokeAnimDB Humanoid-to-Humanoid (H2H)
PMD3.616
8
3D Pose TransferPokeAnimDB Cross-Category Transfer (CCT)
PMD4.312
8
Pose TransferUser Study 20 transfer pairs perceptual evaluation
Pose Similarity3.364
5
Pose TransferMixamo (test)
PMD3.05
4
3D Motion TransferMixamo
PMD0.0029
4
Pose TransferMGN (test)
PMD1.62
4
Part PredictionMixamo
Accuracy0.756
3
Quadrupedal Pose TransferSMAL (Hippos)
PMD10.28
2
Showing 8 of 8 rows

Other info

Follow for update