Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

DemoGen: Synthetic Demonstration Generation for Data-Efficient Visuomotor Policy Learning

About

Visuomotor policies have shown great promise in robotic manipulation but often require substantial amounts of human-collected data for effective performance. A key reason underlying the data demands is their limited spatial generalization capability, which necessitates extensive data collection across different object configurations. In this work, we present DemoGen, a low-cost, fully synthetic approach for automatic demonstration generation. Using only one human-collected demonstration per task, DemoGen generates spatially augmented demonstrations by adapting the demonstrated action trajectory to novel object configurations. Visual observations are synthesized by leveraging 3D point clouds as the modality and rearranging the subjects in the scene via 3D editing. Empirically, DemoGen significantly enhances policy performance across a diverse range of real-world manipulation tasks, showing its applicability even in challenging scenarios involving deformable objects, dexterous hand end-effectors, and bimanual platforms. Furthermore, DemoGen can be extended to enable additional out-of-distribution capabilities, including disturbance resistance and obstacle avoidance.

Zhengrong Xue, Shuying Deng, Zhenyang Chen, Yixuan Wang, Zhecheng Yuan, Huazhe Xu• 2025

Related benchmarks

TaskDatasetResultRank
Visuomotor ManipulationRobot Manipulation Tasks in-distribution 1.0 (ID)
Average Success Rate68.9
13
Visuomotor ManipulationRobot Manipulation Tasks 1.0 (OOD)
Average Success Rate (OOD)40.6
13
Real-world demonstration generationReal-world robot demonstration trajectories
Time Cost (h)0.29
12
Open jarReal-world
Success Rate18.8
9
Grasp BoxReal-world Spatial Generalization
Success Rate16.7
6
Place-BottleReal-world Spatial Generalization
Success Rate0.156
6
Store-ItemReal-world Spatial Generalization
Success Rate16.7
6
Knife CuttingKnife Cutting Source
Success Rate0.9259
4
Mug HangingMug Hanging Source
Success Rate20
4
Teapot PouringTeapot Pouring Source
Success Rate0.5185
4
Showing 10 of 21 rows

Other info

Follow for update