Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Discriminative-Generative Synergy for Occlusion Robust 3D Human Mesh Recovery

About

3D human mesh recovery from monocular RGB images aims to estimate anatomically plausible 3D human models for downstream applications, but remains challenging under partial or severe occlusions. Regression-based methods are efficient yet often produce implausible or inaccurate results in unconstrained scenarios, while diffusion-based methods provide strong generative priors for occluded regions but may weaken fidelity to rare poses due to over-reliance on generation. To address these limitations, we propose a brain-inspired synergistic framework that integrates the discriminative power of vision transformers with the generative capability of conditional diffusion models. Specifically, the ViT-based pathway extracts deterministic visual cues from visible regions, while the diffusion-based pathway synthesizes structurally coherent human body representations. To effectively bridge the two pathways, we design a diverse-consistent feature learning module to align discriminative features with generative priors, and a cross-attention multi-level fusion mechanism to enable bidirectional interaction across semantic levels. Experiments on standard benchmarks demonstrate that our method achieves superior performance on key metrics and shows strong robustness in complex real-world scenarios.

Yang Liu, Zhiyong Zhang• 2026

Related benchmarks

TaskDatasetResultRank
3D Human Mesh Recovery3DPW (test)
MPJPE53.7
341
3D Human Mesh RecoveryCMU Panoptic
Haggl89.6
19
3D Human Mesh Reconstruction3DPW OCC
PA-MPJPE43.2
17
3D Whole-Body Mesh RecoveryAGORA
MPVPE (Hands)34
13
3D Human Mesh RecoveryEHF
PVE (All Body)40.5
9
3D human reconstruction3DPW-PC
MPJPE80
8
3D Human Mesh Recovery3DPW Crowd
MPJPE75.4
7
3D Human Mesh Recovery3DOH
MPJPE80.9
6
3D Human Mesh RecoveryAGORA
F1 Score95
4
Showing 9 of 9 rows

Other info

Follow for update