RelAfford6D: Relational 6D Affordance Graphs for Constraint-Driven Robotic Manipulation
About
Bridging abstract semantics and precise physical control remains a fundamental challenge in open-world robotic manipulation. While recent data-driven policies show promise, their reliance on isolated contact points or latent affordance embeddings lacks the rigorous kinematic constraints necessary for complex articulated objects.To overcome the limitation, we introduce RelAfford6D, a novel training-free framework centered on a Relational 6D Affordance Graph. Given a free-form instruction, our system deduces a semantic topology linking a primary interacting part to its physical anchor. By elevating these topological nodes into precise metric $SE(3)$ poses via vision foundation models, we analytically formulate downstream execution as a kinematic constraint satisfaction problem. The robot synthesizes continuous trajectories by tracking strictly defined physical manifolds (e.g., revolute or prismatic orbits). Coupled with a closed-loop tracking mechanism for dynamic replanning against disturbances, our physically grounded approach achieves superior zero-shot success rates, cross-category generalization and execution robustness in both simulation and the real world environments, outperforming existing data-driven baselines.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Pick Cube | Real-world Robotic Manipulation Pick Cube | Success Rate100 | 9 | |
| Open microwave | Real-World (test) | Success Rate80 | 7 | |
| Press dispenser | Realman RM75 Real-world | Success Rate9 | 6 | |
| StackCube | Rigid Objects Manipulation StackCube | Success Rate100 | 5 | |
| Articulated Object Manipulation | Articulated Object Manipulation (test) | Drawer Success Rate78 | 5 | |
| PushCube | Rigid Objects Manipulation PushCube | Success Rate100 | 5 | |
| Close laptop | Realman RM75 Real-world | Success Rate8 | 3 | |
| Pull Drawer | Realman RM75 Real-world | Success Rate80 | 3 | |
| Screw Bottle | Realman RM75 Real-world | Success Rate9 | 3 | |
| stack cubes | Realman RM75 Real-world | Success Rate100 | 1 |