Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Kinematify: Open-Vocabulary Synthesis of High-DoF Articulated Objects

About

A deep understanding of kinematic structures and movable components is essential for enabling robots to manipulate objects and model their own articulated forms. Such understanding is captured through articulated objects, which are essential for tasks such as physical simulation, motion planning, and policy learning. However, creating these models, particularly for objects with high degrees of freedom (DoF), remains a significant challenge. Existing methods typically rely on motion sequences or strong assumptions from hand-curated datasets, which hinders scalability. In this paper, we introduce Kinematify, an automated framework that synthesizes articulated objects directly from arbitrary RGB images or textual descriptions. Our method addresses two core challenges: (i) inferring kinematic topologies for high-DoF objects and (ii) estimating joint parameters from static geometry. To achieve this, we combine MCTS search for structural inference with geometry-driven optimization for joint reasoning, producing physically consistent and functionally valid descriptions. We evaluate Kinematify on diverse inputs from both synthetic and real-world environments, demonstrating improvements in registration and kinematic topology accuracy over prior work.

Jiawei Wang, Dingyou Wang, Jiaming Hu, Qixuan Zhang, Jingyi Yu, Lan Xu• 2025

Related benchmarks

TaskDatasetResultRank
Kinematic Joint and Topology EstimationFetch Robot
Axis Angle Error23.1
4
Kinematic Joint and Topology EstimationPanda Robot
Axis Angle Error10.42
4
Kinematics ReconstructionPartNet-Mobility Everyday Objects
Axis Angle Error2.92
3
Kinematics ReconstructionUR10e Robot
Axis Angle Error5.34
3
Kinematics ReconstructionUnitree Go2 Robot
Axis Angle Error9.97
3
Kinematics ReconstructionAllegro Robot
Axis Angle Error31.39
3
Kinematics ReconstructionUnitree H1 Robot
Axis Angle Error29.31
3
Kinematic Joint and Topology EstimationEveryday Objects
Axis Angle Error3.78
1
Showing 8 of 8 rows

Other info

Follow for update