Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

A Two-Stage Motion-Aware Framework for mmWave-based Human Mesh Recovery

About

Millimeter-wave (mmWave) radar has emerged as a promising sensing modality for human perception due to its robustness under challenging environmental conditions and strong privacy-preserving properties. However, recovering accurate 3D human body meshes from radar observations remains difficult due to severe signal clutter and the inherently partial nature of radar measurements. Previous works typically adopt end-to-end frameworks that directly regress human body parameters from raw radar data, without decoupling signal interpretation from geometric reasoning or exploiting temporal motion cues, limiting learning performance. To address this, we propose a two-stage framework for radar-based human body reconstruction. First, we introduce a human reflection extraction module that performs coarse-to-fine localization and voxel-wise segmentation to produce a confidence-weighted radar volume encoding voxel-level human likelihood. Second, we design a motion-aware mesh recovery network that reconstructs the human body by jointly modeling per-frame geometry and inter-frame dynamics using a dual-branch architecture. Extensive experiments demonstrate that the proposed method outperforms existing approaches while maintaining computational efficiency.

Hoang Hai Pham, Shuntian Zheng, Jiaqi Li, Yu Guan• 2026

Related benchmarks

TaskDatasetResultRank
Human Mesh RecoveryMilliFlow Hallway
MJE207.1
7
Human Mesh RecoveryMilliFlow Square
MJE196.8
7
Human Mesh RecoveryMilliFlow (Parking Lot)
MJE212.9
7
Human Mesh RecoveryMilliFlow Average
MJE205.6
7
Human Mesh RecoveryM4Human (Cross-Subject)
Mean Vertex Error (MVE)128.5
7
Human Mesh RecoveryM4Human Cross-Action
MVE130.1
7
Showing 6 of 6 rows

Other info

Follow for update