PEAR: Pixel-aligned Expressive humAn mesh Recovery
About
Reconstructing detailed 3D human meshes from a single in-the-wild image remains a fundamental challenge in computer vision. Existing SMPLX-based methods often suffer from slow inference, produce only coarse body poses, and exhibit misalignments or unnatural artifacts in fine-grained regions such as the face and hands. These issues make current approaches difficult to apply to downstream tasks. To address these challenges, we propose PEAR-a fast and robust framework for pixel-aligned expressive human mesh recovery. PEAR explicitly tackles three major limitations of existing methods: slow inference, inaccurate localization of fine-grained human pose details, and insufficient facial expression capture. Specifically, to enable real-time SMPLX parameter inference, we depart from prior designs that rely on high resolution inputs or multi-branch architectures. Instead, we adopt a clean and unified ViT-based model capable of recovering coarse 3D human geometry. To compensate for the loss of fine-grained details caused by this simplified architecture, we introduce pixel-level supervision to optimize the geometry, significantly improving the reconstruction accuracy of fine-grained human details. To make this approach practical, we further propose a modular data annotation strategy that enriches the training data and enhances the robustness of the model. Overall, PEAR is a preprocessing-free framework that can simultaneously infer EHM-s (SMPLX and scaled-FLAME) parameters at over 100 FPS. Extensive experiments on multiple benchmark datasets demonstrate that our method achieves substantial improvements in pose estimation accuracy compared to previous SMPLX-based approaches. Project page: https://wujh2001.github.io/PEAR
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| 3D Human Pose Estimation | 3DPW | PA-MPJPE45.3 | 119 | |
| Human Pose Estimation | LSP extended (test) | PCK@0.0555 | 8 | |
| Human hand reconstruction | UBody OSX (test) | PA-PVE9.8 | 6 | |
| Human hand reconstruction | EHF (test) | PA-PVE12.8 | 6 | |
| Human Body Pose Estimation | COCO | PCK@0.0581 | 4 | |
| Human Body Pose Estimation | AGORA | Body MVE59.3 | 4 | |
| Human Head Mesh Recovery | UBody (test) | MLE0.72 | 4 | |
| Human Head Mesh Recovery | 3DPW (test) | MLE3.36 | 4 | |
| Human Body Pose Estimation | PoseTrack | PCK@0.0587 | 3 |