Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

JUICER: Data-Efficient Imitation Learning for Robotic Assembly

About

While learning from demonstrations is powerful for acquiring visuomotor policies, high-performance imitation without large demonstration datasets remains challenging for tasks requiring precise, long-horizon manipulation. This paper proposes a pipeline for improving imitation learning performance with a small human demonstration budget. We apply our approach to assembly tasks that require precisely grasping, reorienting, and inserting multiple parts over long horizons and multiple task phases. Our pipeline combines expressive policy architectures and various techniques for dataset expansion and simulation-based data augmentation. These help expand dataset support and supervise the model with locally corrective actions near bottleneck regions requiring high precision. We demonstrate our pipeline on four furniture assembly tasks in simulation, enabling a manipulator to assemble up to five parts over nearly 2500 time steps directly from RGB images, outperforming imitation and data augmentation baselines. Project website: https://imitation-juicer.github.io/.

Lars Ankile, Anthony Simeonov, Idan Shenfeld, Pulkit Agrawal• 2024

Related benchmarks

TaskDatasetResultRank
Furniture AssemblyFurnitureBench one_leg Low
Success Rate68
8
Furniture AssemblyFurnitureBench one_leg Med
Success Rate22
8
Furniture AssemblyFurnitureBench lamp (Low)
Success Rate27
8
Furniture AssemblyFurnitureBench lamp Med
Success Rate12
8
Furniture AssemblyFurnitureBench lamp (High)
Success Rate2
8
Furniture AssemblyFurnitureBench round_table (Low)
Success Rate23
8
Furniture AssemblyFurnitureBench round_table Med
Success Rate8
8
Furniture AssemblyFurnitureBench round_table High
Success Rate2
8
Furniture AssemblyFurnitureBench cabinet (Low)
Success Rate11
8
Furniture AssemblyFurnitureBench cabinet (Med)
Success Rate5
8
Showing 10 of 11 rows

Other info

Follow for update