Shape-Aware Human Pose and Shape Reconstruction Using Multi-View Images
About
We propose a scalable neural network framework to reconstruct the 3D mesh of a human body from multi-view images, in the subspace of the SMPL model. Use of multi-view images can significantly reduce the projection ambiguity of the problem, increasing the reconstruction accuracy of the 3D human body under clothing. Our experiments show that this method benefits from the synthetic dataset generated from our pipeline since it has good flexibility of variable control and can provide ground-truth for validation. Our method outperforms existing methods on real-world images, especially on shape estimations.
Junbang Liang, Ming C. Lin• 2019
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| 3D Human Pose Estimation | MPI-INF-3DHP (test) | PCK95 | 559 | |
| 3D Human Pose Estimation | Human3.6M (test) | MPJPE (Average)45.13 | 547 | |
| 3D Human Pose Estimation | Human3.6M | MPJPE79.9 | 160 | |
| 3D human shape and pose estimation | MPI-INF-3DHP | MPJPE-PA59 | 29 | |
| Human Shape Estimation | Tape-Measured Data Standing | Avg Relative Error6.23 | 4 | |
| Human Shape Estimation | Tape-Measured Data (Sitting) | Avg Relative Error5.26 | 4 | |
| 3D Human Pose and Shape Estimation | 3D People in the Wild (test) | Mean Joint Error96.86 | 3 |
Showing 7 of 7 rows