Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

KAMA: 3D Keypoint Aware Body Mesh Articulation

About

We present KAMA, a 3D Keypoint Aware Mesh Articulation approach that allows us to estimate a human body mesh from the positions of 3D body keypoints. To this end, we learn to estimate 3D positions of 26 body keypoints and propose an analytical solution to articulate a parametric body model, SMPL, via a set of straightforward geometric transformations. Since keypoint estimation directly relies on image clues, our approach offers significantly better alignment to image content when compared to state-of-the-art approaches. Our proposed approach does not require any paired mesh annotations and is able to achieve state-of-the-art mesh fittings through 3D keypoint regression only. Results on the challenging 3DPW and Human3.6M demonstrate that our approach yields state-of-the-art body mesh fittings.

Umar Iqbal, Kevin Xie, Yunrong Guo, Jan Kautz, Pavlo Molchanov• 2021

Related benchmarks

TaskDatasetResultRank
3D Human Mesh Recovery3DPW (test)--
264
Human Mesh Recovery3DPW--
123
3D Human Pose Estimation3DPW
PA-MPJPE51.1
119
3D Human Mesh Recovery3DPW
PA-MPJPE51.1
72
Human Mesh RecoveryHuman3.6M
Reconstruction Error40.2
47
3D Body Mesh RecoveryHuman3.6M
PA-MPJPE40.2
46
Global Human Mesh RecoveryDynamic Human3.6M 1.0 (Visible frames)
PA-MPJPE47.4
8
Global Human Mesh RecoveryDynamic Human3.6M 1.0 (All frames)
G-MPJPE1.32e+3
8
Global Human Mesh RecoveryDynamic Human3.6M 1.0 (Invisible frames)
FID28.9
8
Showing 9 of 9 rows

Other info

Follow for update