Object-Informed Model Predictive Path Integral Control for Non-Prehensile Robot Manipulation
About
Long-horizon planning for non-prehensile robot manipulation is challenging due to underactuated and discontinuous interactions. We propose a hierarchical formulation of model predictive path integral (MPPI) control that guides robot-level planning with a separately computed object-level plan to achieve efficient long-horizon prediction. We first solve a simplified object-only problem, assuming the object can be actuated directly, and use the planned object trajectory as a reference in solving the joint robot-object planning problem. We evaluate our method in both simulation and hardware using a 6-DoF xArm6 manipulator to perform object pushing tasks in which the target object must reach a goal while avoiding static obstacles, necessitating non-myopic reasoning. Our object-informed MPPI increases task success by 40\% with a 26\% faster control frequency in simulation, and by 20\% in real experiments with similar computation as regular MPPI.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Non-prehensile Object Rearrangement | IsaacGym Simulation Task 01 1.0 (test) | Success Rate100 | 3 | |
| Non-prehensile Object Rearrangement | IsaacGym Simulation Task 02 1.0 (test) | Success Rate (SR)100 | 3 | |
| Non-prehensile Object Rearrangement | IsaacGym Simulation Task 03 1.0 (test) | Success Rate (SR)90 | 3 | |
| Non-prehensile Object Rearrangement | IsaacGym Simulation Task 04 1.0 (test) | Success Rate90 | 3 | |
| Non-prehensile Object Rearrangement | IsaacGym Simulation Task 05 1.0 (test) | Success Rate (SR)70 | 3 | |
| Non-prehensile Object Rearrangement | IsaacGym Simulation Mean across Tasks 01-05 1.0 (test) | Success Rate (SR)82 | 3 | |
| Object pushing (Task 01) | xArm6 Hardware | Success Rate (SR)100 | 3 | |
| Object pushing (Task 02) | xArm6 Hardware | Success Rate (SR)80 | 3 |