Unleashing Humanoid Reaching Potential via Real-world-Ready Skill Space
About
Humans possess a large reachable space in the 3D world, enabling interaction with objects at varying heights and distances. However, realizing such large-space reaching on humanoids is a complex whole-body control problem and requires the robot to master diverse skills simultaneously-including base positioning and reorientation, height and body posture adjustments, and end-effector pose control. Learning from scratch often leads to optimization difficulty and poor sim2real transferability. To address this challenge, we propose Real-world-Ready Skill Space (R2S2). Our approach begins with a carefully designed skill library consisting of real-world-ready primitive skills. We ensure optimal performance and robust sim2real transfer through individual skill tuning and sim2real evaluation. These skills are then ensembled into a unified latent space, serving as a structured prior that helps task execution in an efficient and sim2real transferable manner. A high-level planner, trained to sample skills from this space, enables the robot to accomplish real-world goal-reaching tasks. We demonstrate zero-shot sim2real transfer and validate R2S2 in multiple challenging goal-reaching scenarios.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Humanoid Reachable Workspace Estimation | Isaac Lab Evaluation Environments 41 | Min Height0.35 | 6 | |
| Loco-manipulation tracking | IsaacLab Whole Command Space | Root Linear Velocity Tracking Error0.13 | 6 | |
| Loco-manipulation tracking | IsaacLab Edge Command Space | Root Linear Velocity Tracking Error (Ev)0.17 | 6 | |
| Loco-manipulation tracking | IsaacLab Wrist Loaded (2kg) | Error (Root Linear Velocity)0.15 | 6 | |
| Loco-manipulation tracking | IsaacLab Command Mutation | Root Linear Velocity Tracking Error (Ev)0.2 | 6 |