Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

RelAfford6D: Relational 6D Affordance Graphs for Constraint-Driven Robotic Manipulation

About

Bridging abstract semantics and precise physical control remains a fundamental challenge in open-world robotic manipulation. While recent data-driven policies show promise, their reliance on isolated contact points or latent affordance embeddings lacks the rigorous kinematic constraints necessary for complex articulated objects.To overcome the limitation, we introduce RelAfford6D, a novel training-free framework centered on a Relational 6D Affordance Graph. Given a free-form instruction, our system deduces a semantic topology linking a primary interacting part to its physical anchor. By elevating these topological nodes into precise metric $SE(3)$ poses via vision foundation models, we analytically formulate downstream execution as a kinematic constraint satisfaction problem. The robot synthesizes continuous trajectories by tracking strictly defined physical manifolds (e.g., revolute or prismatic orbits). Coupled with a closed-loop tracking mechanism for dynamic replanning against disturbances, our physically grounded approach achieves superior zero-shot success rates, cross-category generalization and execution robustness in both simulation and the real world environments, outperforming existing data-driven baselines.

Guodong Zhang, Qichen He, Wenyuan Xie, Shaokai Wu, Yanbiao Ji, Qiuchang Li, Bayram Bayramli, Yue Ding, Hongtao Lu• 2026

Related benchmarks

TaskDatasetResultRank
Pick CubeReal-world Robotic Manipulation Pick Cube
Success Rate100
9
Open microwaveReal-World (test)
Success Rate80
7
Press dispenserRealman RM75 Real-world
Success Rate9
6
StackCubeRigid Objects Manipulation StackCube
Success Rate100
5
Articulated Object ManipulationArticulated Object Manipulation (test)
Drawer Success Rate78
5
PushCubeRigid Objects Manipulation PushCube
Success Rate100
5
Close laptopRealman RM75 Real-world
Success Rate8
3
Pull DrawerRealman RM75 Real-world
Success Rate80
3
Screw BottleRealman RM75 Real-world
Success Rate9
3
stack cubesRealman RM75 Real-world
Success Rate100
1
Showing 10 of 10 rows

Other info

Follow for update