Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Semantic Graph Convolutional Networks for 3D Human Pose Regression

About

In this paper, we study the problem of learning Graph Convolutional Networks (GCNs) for regression. Current architectures of GCNs are limited to the small receptive field of convolution filters and shared transformation matrix for each node. To address these limitations, we propose Semantic Graph Convolutional Networks (SemGCN), a novel neural network architecture that operates on regression tasks with graph-structured data. SemGCN learns to capture semantic information such as local and global node relationships, which is not explicitly represented in the graph. These semantic relationships can be learned through end-to-end training from the ground truth without additional supervision or hand-crafted rules. We further investigate applying SemGCN to 3D human pose regression. Our formulation is intuitive and sufficient since both 2D and 3D human poses can be represented as a structured graph encoding the relationships between joints in the skeleton of a human body. We carry out comprehensive studies to validate our method. The results prove that SemGCN outperforms state of the art while using 90% fewer parameters.

Long Zhao, Xi Peng, Yu Tian, Mubbasir Kapadia, Dimitris N. Metaxas• 2019

Related benchmarks

TaskDatasetResultRank
3D Human Pose EstimationMPI-INF-3DHP (test)
PCK86
559
3D Human Pose EstimationHuman3.6M (test)
MPJPE (Average)40.8
547
3D Human Pose Estimation3DPW (test)
PA-MPJPE102
505
3D Human Pose EstimationHuman3.6M (Protocol #1)
MPJPE (Avg.)42.5
440
3D Human Pose EstimationHuman3.6M (Protocol 2)
Average MPJPE46.3
315
3D Human Pose EstimationHuman3.6M Protocol 1 (test)
Dir. Error (Protocol 1)34.4
183
3D Human Pose EstimationHuman3.6M (subjects 9 and 11)
Average Error43.8
180
3D Human Pose EstimationHuman3.6M Protocol #2 (test)
Average Error31.1
140
3D Human Pose EstimationHuman3.6M (S9, S11)
Average Error (MPJPE Avg)57.6
94
3D Human Pose EstimationHuman3.6M v1 (test)
Avg Performance43.8
58
Showing 10 of 14 rows

Other info

Code

Follow for update