Latent Diffeomorphic Co-Design of End-Effectors for Deformable and Fragile Object Manipulation
About
Manipulating deformable and fragile objects remains a fundamental challenge in robotics due to complex contact dynamics and strict requirements on object integrity. Existing approaches typically optimize either end-effector design or control strategies in isolation, limiting achievable performance. In this work, we present the first co-design framework that jointly optimizes end-effector morphology and manipulation control for deformable and fragile object manipulation. We introduce (1) a latent diffeomorphic shape parameterization enabling expressive yet tractable end-effector geometry optimization, (2) a stress-aware bi-level co-design pipeline coupling morphology and control optimization, and (3) a privileged-to-pointcloud policy distillation scheme for zero-shot real-world deployment. We evaluate our approach on challenging food manipulation tasks, including grasping and pushing jelly and scooping fillets. Simulation and real-world experiments demonstrate the effectiveness of the proposed method.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Jelly Grasping | onigiri | Score6.42e+3 | 4 | |
| Jelly Grasping | cylinder | Score1.44e+3 | 4 | |
| Jelly Pushing | onigiri | Score J7.02e+3 | 3 | |
| Jelly Grasping | large cube | Score1.95e+3 | 3 | |
| Jelly Pushing | cylinder | Score J855 | 3 | |
| Fillet Scooping | Fillet 1.0 (test) | Score J293 | 2 |