BlazePose: On-device Real-time Body Pose tracking
About
We present BlazePose, a lightweight convolutional neural network architecture for human pose estimation that is tailored for real-time inference on mobile devices. During inference, the network produces 33 body keypoints for a single person and runs at over 30 frames per second on a Pixel 2 phone. This makes it particularly suited to real-time use cases like fitness tracking and sign language recognition. Our main contributions include a novel body pose tracking solution and a lightweight body pose estimation neural network that uses both heatmaps and regression to keypoint coordinates.
Valentin Bazarevsky, Ivan Grishchenko, Karthik Raveendran, Tyler Zhu, Fan Zhang, Matthias Grundmann• 2020
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Body Pose Estimation | COCO-SinglePerson 1.0 (val) | AP35.4 | 10 | |
| Human Pose Estimation | Yoga Dataset | PCK@0.284.5 | 3 | |
| Human Pose Estimation | AR Dataset | PCK@0.284.1 | 3 | |
| 3D Human Pose Estimation | Physio2.2M | 3D MPJPE100.3 | 3 |
Showing 4 of 4 rows