Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

EgoGuide: Egocentric Guidance for Efficient Robot-Free Demonstration Collection and Learning

About

Robot learning from real-world demonstrations is currently constrained by data scaling. Universal Manipulation Interface (UMI) provides an efficient robot-free data collection interface, yet current UMI-style pipelines often collect redundant demonstrations and lack global scene context. To improve data efficiency, we present EgoGuide, a collection interface that records synchronized wrist and head/egocentric observations and couples them with online visual-geometric data quality guidance. We also introduce a Gated Egocentric Residual Policy for robust learning from a viewpoint-varying egocentric camera, allowing head/egocentric context to correct ambiguous local observations while preserving stable wrist-view control. Real-world experiments show that EgoGuide reduces the required number of data episodes and improves data efficiency. The residual policy further improves robustness under visual occlusion. Project Page: https://silicx.github.io/EgoGuide

Yue Xu, Mingtao Nie, Tianle Li, Hong Li, Yibo Luo, Siyuan Huang, Yong-Lu Li• 2026

Related benchmarks

TaskDatasetResultRank
Garlic StorageGarlic Storage
Success Rate55
3
Pepper SortingPepper Sorting
SR80
3
Pick CubePick Cube
Success Rate (SR)80
3
Rubiks Cube ManipulationRubiks Cube--
3
Showing 4 of 4 rows

Other info

Follow for update