Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

EquiBot: SIM(3)-Equivariant Diffusion Policy for Generalizable and Data Efficient Learning

About

Building effective imitation learning methods that enable robots to learn from limited data and still generalize across diverse real-world environments is a long-standing problem in robot learning. We propose Equibot, a robust, data-efficient, and generalizable approach for robot manipulation task learning. Our approach combines SIM(3)-equivariant neural network architectures with diffusion models. This ensures that our learned policies are invariant to changes in scale, rotation, and translation, enhancing their applicability to unseen environments while retaining the benefits of diffusion-based policy learning such as multi-modality and robustness. We show on a suite of 6 simulation tasks that our proposed method reduces the data requirements and improves generalization to novel scenarios. In the real world, with 10 variations of 6 mobile manipulation tasks, we show that our method can easily generalize to novel objects and scenes after learning from just 5 minutes of human demonstrations in each task.

Jingyun Yang, Zi-ang Cao, Congyue Deng, Rika Antonova, Shuran Song, Jeannette Bohg• 2024

Related benchmarks

TaskDatasetResultRank
Coffee Making/HandlingRobomimic MimicGen Coffee (D2)
Success Rate0.00e+0
25
Mug CleanupRobomimic MimicGen Mug Cleanup (D1)
Success Rate24
20
Coffee PreparationRobomimic/MimicGen Coffee Prep. (D1)
Success Rate2
20
Robot ManipulationMimicGen Square D2
Success Rate0.00e+0
15
Robot ManipulationMimicGen Nut Assembly D0
Success Rate3
15
Robot ManipulationMimicGen Hammer Cleanup D1
Success Rate14
10
Robot ManipulationMimicGen Stack D1
Success Rate0.00e+0
10
Robot ManipulationMimicGen Stack Three D1
Success Rate0.00e+0
10
Robot Manipulation Policy InferenceMimicGen
Coffee Success Rate (D2)2.06
8
Robotic ManipulationCoffee D2 MimicGen (10° perturbation)
Success Rate0.00e+0
5
Showing 10 of 17 rows

Other info

Follow for update