Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

EgoPriMo: Egocentric Motion Generation for Interactive Humanoid Control

About

Humanoid robots require whole-body motions that adapt to scene context, task requirements, and user intent. Motion tracking reproduces specified trajectories, and humanoid vision-language-action systems provide semantic interfaces, but neither offers a scalable and interactive prior for broad full-body behavior. We introduce EgoPriMo (Egocentric Motion Prior for Humanoid Robots), a unified framework that learns such priors from egocentric human demonstrations. Given egocentric observations and a text prompt, EgoPriMo reconstructs, generates, and forecasts SMPL-based full-body motion. Language is used as a high-level control signal rather than a complete motion specification. At the core of EgoPriMo is a Triple-stream DiT that jointly models body dynamics, egocentric visual context, and text; task-conditioning masks route different tasks and missing-modality data through the same checkpoint. Experiments on Nymeria and EgoExo4D show that one checkpoint improves egocentric motion generation over UniEgoMotion while supporting reconstruction and forecasting; the generated SMPL motions can also be executed by a Unitree humanoid controller. These results indicate a practical path from scalable egocentric observations to generalizable and interactive humanoid motion priors.

Haoyang Ge, Peng Ren, Yukun Shi, Cong Huang, Kun Li, Kai Chen• 2026

Related benchmarks

TaskDatasetResultRank
Egocentric Motion ReconstructionNymeria
MPJPE0.301
4
Egocentric Motion GenerationNymeria (val)
MPJPE0.477
2
Egocentric Motion GenerationEgoExo4D (val)
MPJPE0.454
2
Egocentric Motion GenerationNymeria
MPJPE0.477
2
Showing 4 of 4 rows

Other info

Follow for update