Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Self-Supervised Category-Level Articulated Object Pose Estimation with Part-Level SE(3) Equivariance

About

Category-level articulated object pose estimation aims to estimate a hierarchy of articulation-aware object poses of an unseen articulated object from a known category. To reduce the heavy annotations needed for supervised learning methods, we present a novel self-supervised strategy that solves this problem without any human labels. Our key idea is to factorize canonical shapes and articulated object poses from input articulated shapes through part-level equivariant shape analysis. Specifically, we first introduce the concept of part-level SE(3) equivariance and devise a network to learn features of such property. Then, through a carefully designed fine-grained pose-shape disentanglement strategy, we expect that canonical spaces to support pose estimation could be induced automatically. Thus, we could further predict articulated object poses as per-part rigid transformations describing how parts transform from their canonical part spaces to the camera space. Extensive experiments demonstrate the effectiveness of our method on both complete and partial point clouds from synthetic and real articulated object datasets.

Xueyi Liu, Ji Zhang, Ruizhen Hu, Haibin Huang, He Wang, Li Yi• 2023

Related benchmarks

TaskDatasetResultRank
Part Pose EstimationHOI4D synthetic (test)
Mean Part Rotation Error (R)7.71
18
Part SegmentationHOI4D synthetic (test)
Part Segmentation IoU86.04
15
Joint parameter estimationHOI4D synthetic (test)
Joint Direction Error (D)17.75
15
Part Pose EstimationShape2Motion synthetic (test)
Mean Part Rotation Error (R)5.91
12
Part SegmentationShape2Motion synthetic (test)
Segmentation IoU (Part)76.22
10
Joint parameter estimationShape2Motion synthetic (test)
Joint Direction Error (D)20.3
10
Showing 6 of 6 rows

Other info

Follow for update