Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

AutoURDF: Unsupervised Robot Modeling from Point Cloud Frames Using Cluster Registration

About

Robot description models are essential for simulation and control, yet their creation often requires significant manual effort. To streamline this modeling process, we introduce AutoURDF, an unsupervised approach for constructing description files for unseen robots from point cloud frames. Our method leverages a cluster-based point cloud registration model that tracks the 6-DoF transformations of point clusters. Through analyzing cluster movements, we hierarchically address the following challenges: (1) moving part segmentation, (2) body topology inference, and (3) joint parameter estimation. The complete pipeline produces robot description files that are fully compatible with existing simulators. We validate our method across a variety of robots, using both synthetic and real-world scan data. Results indicate that our approach outperforms previous methods in registration and body topology estimation accuracy, offering a scalable solution for automated robot modeling.

Jiong Lin, Lechen Zhang, Kwansoo Lee, Jialong Ning, Judah Goldfeder, Hod Lipson• 2024

Related benchmarks

TaskDatasetResultRank
Kinematic Joint and Topology EstimationFetch Robot--
4
Kinematic Joint and Topology EstimationPanda Robot--
4
Robot Body Topology InferenceAutoURDF 1.0 (val)
WX200 Error0.33
3
Kinematics ReconstructionPartNet-Mobility Everyday Objects--
3
Kinematics ReconstructionUR10e Robot--
3
Kinematics ReconstructionUnitree Go2 Robot--
3
Kinematics ReconstructionAllegro Robot--
3
Kinematics ReconstructionUnitree H1 Robot--
3
Point cloud registrationAutoURDF 1.0 (val)
WX200 Registration Error7.49
2
Showing 9 of 9 rows

Other info

Code

Follow for update