Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

GenDexGrasp: Generalizable Dexterous Grasping

About

Generating dexterous grasping has been a long-standing and challenging robotic task. Despite recent progress, existing methods primarily suffer from two issues. First, most prior arts focus on a specific type of robot hand, lacking the generalizable capability of handling unseen ones. Second, prior arts oftentimes fail to rapidly generate diverse grasps with a high success rate. To jointly tackle these challenges with a unified solution, we propose GenDexGrasp, a novel hand-agnostic grasping algorithm for generalizable grasping. GenDexGrasp is trained on our proposed large-scale multi-hand grasping dataset MultiDex synthesized with force closure optimization. By leveraging the contact map as a hand-agnostic intermediate representation, GenDexGrasp efficiently generates diverse and plausible grasping poses with a high success rate and can transfer among diverse multi-fingered robotic hands. Compared with previous methods, GenDexGrasp achieves a three-way trade-off among success rate, inference speed, and diversity. Code is available at https://github.com/tengyu-liu/GenDexGrasp.

Puhao Li, Tengyu Liu, Yuyang Li, Yiran Geng, Yixin Zhu, Yaodong Yang, Siyuan Huang• 2022

Related benchmarks

TaskDatasetResultRank
Cross-Embodiment Dexterous Grasp GenerationMultiDex
Success Rate (Barrett)67
7
Dexterous GraspingReal-world Cluttered Scenes
Runtime (s)16.42
4
Grasp GenerationGenDexGrasp Allegro Hand (unseen objects)
Success Rate51
4
Grasp GenerationGenDexGrasp Barrett Hand (unseen objects)
Success Rate67
4
Grasp GenerationGenDexGrasp ShadowHand (unseen objects)
Success Rate54.2
4
Dexterous Grasp GenerationMulti-GraspLLM
Success Rate (Barrett)29.3
3
Dexterous Grasp GenerationObjaverse
Success Rate (Barrett)57.9
3
Showing 7 of 7 rows

Other info

Follow for update