Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

BiPreManip: Learning Affordance-Based Bimanual Preparatory Manipulation through Anticipatory Collaboration

About

Many everyday objects are difficult to directly grasp (e.g., a flat iPad) or manipulate functionally (e.g., opening the cap of a pen lying on a desk). Such tasks require sequential, asymmetric coordination between two arms, where one arm performs preparatory manipulation that enables the other's goal-directed action - for instance, pushing the iPad to the table's edge before picking it up, or lifting the pen body to allow the other hand to remove its cap. In this work, we introduce Collaborative Preparatory Manipulation, a class of bimanual manipulation tasks that demand understanding object semantics and geometry, anticipating spatial relationships, and planning long-horizon coordinated actions between the two arms. To tackle this challenge, we propose a visual affordance-based framework that first envisions the final goal-directed action and then guides one arm to perform a sequence of preparatory manipulations that facilitate the other arm's subsequent operation. This affordance-centric representation enables anticipatory inter-arm reasoning and coordination, generalizing effectively across various objects spanning diverse categories. Extensive experiments in both simulation and the real world demonstrate that our approach substantially improves task success rates and generalization compared to competitive baselines.

Yan Shen, Feng Jiang, Zichen He, Xiaoqi Li, Yuchen Liu, Zhiyu Li, Ruihai Wu, Hao Dong• 2026

Related benchmarks

TaskDatasetResultRank
Articulated ManipulationShapeNet PartNet-Mobility seen objects
Bottle Success Rate30
6
Articulated ManipulationShapeNet PartNet-Mobility unseen objects
Bottle Success Rate26
6
Edge-PushingShapeNet PartNet-Mobility seen objects
Success Rate (Bowl)49
6
Edge-PushingShapeNet PartNet-Mobility unseen objects
Success Rate (Bowl)52
6
Plate-LiftingPerAct seen objects 2
Plate Success Rate85
6
Plate-LiftingPerAct2 unseen objects
Plate Success Rate82
6
Articulated ManipulationReal-world Articulated Bottle
Success Rate6
3
Articulated ManipulationReal-world Articulated Dispenser
Success Rate8
3
Edge ManipulationReal-world Edge Book
Success Rate7
3
Edge ManipulationReal-world Edge Hat
Success Rate8
3
Showing 10 of 12 rows

Other info

Follow for update