Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Generative Skill Chaining: Long-Horizon Skill Planning with Diffusion Models

About

Long-horizon tasks, usually characterized by complex subtask dependencies, present a significant challenge in manipulation planning. Skill chaining is a practical approach to solving unseen tasks by combining learned skill priors. However, such methods are myopic if sequenced greedily and face scalability issues with search-based planning strategy. To address these challenges, we introduce Generative Skill Chaining~(GSC), a probabilistic framework that learns skill-centric diffusion models and composes their learned distributions to generate long-horizon plans during inference. GSC samples from all skill models in parallel to efficiently solve unseen tasks while enforcing geometric constraints. We evaluate the method on various long-horizon tasks and demonstrate its capability in reasoning about action dependencies, constraint handling, and generalization, along with its ability to replan in the face of perturbations. We show results in simulation and on real robot to validate the efficiency and scalability of GSC, highlighting its potential for advancing long-horizon task planning. More details are available at: https://generative-skill-chaining.github.io/

Utkarsh A. Mishra, Shangjie Xue, Yongxin Chen, Danfei Xu• 2023

Related benchmarks

TaskDatasetResultRank
Object ManipulationOGBench cube play (Double)
Success Rate70
39
Object ManipulationOGBench cube play (Single)
Success Rate100
30
Object ManipulationOGBench cube play (Quadruple)
Success Rate30
28
Trajectory Stitchingpointmaze giant-stitch v0
Success Rate39
21
Goal-conditioned locomotionOGBench HumanoidMaze-Stitch Medium
Success Rate92
19
Goal-conditioned locomotionOGBench HumanoidMaze-Stitch Large
Success Rate70
19
Object ManipulationOGBench cube play (Triple)
Success Rate45
19
Robotic PlanningOGBench PointMaze Giant 48 (stitch)
Success Rate29
16
Robotic PlanningOGBench AntMaze Giant 48 (stitch)
Success Rate20
16
Robotic PlanningOGBench Scene 48 (play)
Success Rate0.08
16
Showing 10 of 43 rows

Other info

Follow for update