KAMA: 3D Keypoint Aware Body Mesh Articulation
About
We present KAMA, a 3D Keypoint Aware Mesh Articulation approach that allows us to estimate a human body mesh from the positions of 3D body keypoints. To this end, we learn to estimate 3D positions of 26 body keypoints and propose an analytical solution to articulate a parametric body model, SMPL, via a set of straightforward geometric transformations. Since keypoint estimation directly relies on image clues, our approach offers significantly better alignment to image content when compared to state-of-the-art approaches. Our proposed approach does not require any paired mesh annotations and is able to achieve state-of-the-art mesh fittings through 3D keypoint regression only. Results on the challenging 3DPW and Human3.6M demonstrate that our approach yields state-of-the-art body mesh fittings.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| 3D Human Mesh Recovery | 3DPW (test) | -- | 264 | |
| Human Mesh Recovery | 3DPW | -- | 123 | |
| 3D Human Pose Estimation | 3DPW | PA-MPJPE51.1 | 119 | |
| 3D Human Mesh Recovery | 3DPW | PA-MPJPE51.1 | 72 | |
| Human Mesh Recovery | Human3.6M | Reconstruction Error40.2 | 47 | |
| 3D Body Mesh Recovery | Human3.6M | PA-MPJPE40.2 | 46 | |
| Global Human Mesh Recovery | Dynamic Human3.6M 1.0 (Visible frames) | PA-MPJPE47.4 | 8 | |
| Global Human Mesh Recovery | Dynamic Human3.6M 1.0 (All frames) | G-MPJPE1.32e+3 | 8 | |
| Global Human Mesh Recovery | Dynamic Human3.6M 1.0 (Invisible frames) | FID28.9 | 8 |