Cross-Embodiment Robot Manipulation via a Unified Hand Action Space
About
Robot manipulation policies are typically tied to specific robotic hand embodiments, limiting the transfer of learned behaviors across platforms with different kinematic structures. In this work, we propose the Unified Hand Action Space (UHAS), a sphere-based unified action representation for cross-embodiment dexterous manipulation. UHAS represents robotic hand actions as geometric deformations of a canonical sphere and uses a Cascade Inverse Kinematics (CIK) algorithm to map the shared representation to embodiment-specific joint configurations. Using reinforcement learning, we train dexterous manipulation policies directly in the proposed action space for in-hand cube reorientation tasks. We evaluate our method in both simulation and real-world experiments across multiple robotic hands, including the Allegro Hand, LEAP Hand, Shadow Hand, and MANO Human Hand. Experimental results demonstrate effective dexterous manipulation, zero-shot transfer to unseen hands, rapid finetuning across embodiments, and successful real-world deployment. Our experiments show that the proposed UHAS representation enables stable dexterous control and cross-embodiment policy transfer across robotic hands.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| In-hand cube reorientation | Allegro hand | Success Rate99.2 | 4 | |
| In-hand cube reorientation | LEAP hand | Success Rate0.997 | 4 | |
| In-hand cube reorientation | Shadow hand | Success Rate99.3 | 4 | |
| In-hand cube reorientation | MANO hand | Success Rate99.8 | 4 | |
| In-hand cube reorientation | Physical LEAP Hand Real-world | Metric 13 | 4 | |
| In-hand cube reorientation | Allegro Hand Real-world Setup (10 independent trials) | Trial 1 Reorientation Metric0.00e+0 | 3 |