UniBiDex: A Unified Teleoperation Framework for Robotic Bimanual Dexterous Manipulation
About
We present UniBiDex a unified teleoperation framework for robotic bimanual dexterous manipulation that supports both VRbased and leaderfollower input modalities UniBiDex enables realtime contactrich dualarm teleoperation by integrating heterogeneous input devices into a shared control stack with consistent kinematic treatment and safety guarantees The framework employs nullspace control to optimize bimanual configurations ensuring smooth collisionfree and singularityaware motion across tasks We validate UniBiDex on a longhorizon kitchentidying task involving five sequential manipulation subtasks demonstrating higher task success rates smoother trajectories and improved robustness compared to strong baselines By releasing all hardware and software components as opensource we aim to lower the barrier to collecting largescale highquality human demonstration datasets and accelerate progress in robot learning.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Clamp Attachment | Household kitchen-tidying | Time (s)182 | 4 | |
| Item Unpacking | Household kitchen-tidying | Time (s)1.14e+3 | 4 | |
| Overall Task performance | Household kitchen-tidying | Time (s)3.20e+3 | 4 | |
| Shelf Organization | Household kitchen-tidying | Time (s)944 | 4 | |
| Towel Folding | Household kitchen-tidying | Time (s)563 | 4 | |
| Towel Placement | Household kitchen-tidying | Time (s)382 | 4 |