Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

A-SDF: Learning Disentangled Signed Distance Functions for Articulated Shape Representation

About

Recent work has made significant progress on using implicit functions, as a continuous representation for 3D rigid object shape reconstruction. However, much less effort has been devoted to modeling general articulated objects. Compared to rigid objects, articulated objects have higher degrees of freedom, which makes it hard to generalize to unseen shapes. To deal with the large shape variance, we introduce Articulated Signed Distance Functions (A-SDF) to represent articulated shapes with a disentangled latent space, where we have separate codes for encoding shape and articulation. We assume no prior knowledge on part geometry, articulation status, joint type, joint axis, and joint location. With this disentangled continuous representation, we demonstrate that we can control the articulation input and animate unseen instances with unseen joint angles. Furthermore, we propose a Test-Time Adaptation inference algorithm to adjust our model during inference. We demonstrate our model generalize well to out-of-distribution and unseen data, e.g., partial point clouds and real-world depth images.

Jiteng Mu, Weichao Qiu, Adam Kortylewski, Alan Yuille, Nuno Vasconcelos, Xiaolong Wang• 2021

Related benchmarks

TaskDatasetResultRank
3D Shape ReconstructionSAPIEN unseen synthetic shapes (test)
Score (Laptop)0.58
8
Articulated Object ModelingShape2Motion (test)
IoU55.2
6
Shape InterpolationSAPIEN Interpolation (test)
Laptop Error0.359
4
Geometry ReconstructionSynthetic dataset
Whole Chamfer Distance2.48
4
OOD DetectionPediatric Airway dataset Subglottic Stenosis OOD
AUC0.262
4
Global intrinsic time estimationANNY (test)
r1
3
Mean Trajectory ReconstructionStarman(G) synthetic (test)
CD0.137
3
Articulated Object ReconstructionCARTO Synthetic Kitchen (test)
IoU @ 0.2545.2
3
Global intrinsic time estimationStarman(G) (test)
r0.992
3
Mean Trajectory ReconstructionStarman(L) synthetic (test)
CD0.288
3
Showing 10 of 18 rows

Other info

Follow for update