ScrewNet: Category-Independent Articulation Model Estimation From Depth Images Using Screw Theory
About
Robots in human environments will need to interact with a wide variety of articulated objects such as cabinets, drawers, and dishwashers while assisting humans in performing day-to-day tasks. Existing methods either require objects to be textured or need to know the articulation model category a priori for estimating the model parameters for an articulated object. We propose ScrewNet, a novel approach that estimates an object's articulation model directly from depth images without requiring a priori knowledge of the articulation model category. ScrewNet uses screw theory to unify the representation of different articulation types and perform category-independent articulation model estimation. We evaluate our approach on two benchmarking datasets and compare its performance with a current state-of-the-art method. Results demonstrate that ScrewNet can successfully estimate the articulation models and their parameters for novel objects across articulation model categories with better on average accuracy than the prior state-of-the-art method. Project webpage: https://pearl-utexas.github.io/ScrewNet/
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Articulated Object Joint Estimation | PartNet-Mobility Simulated Dataset Seen Categories v0 (test) | Orientation Error (°)20.74 | 33 | |
| Articulated Object Joint Estimation | Real world dataset Seen categories 1.0 (seen_objects) | Axis Orientation Error (°)28.42 | 12 | |
| Articulated Object Joint Estimation | PartNet-Mobility Simulated Dataset Unseen Categories v0 (test) | Orientation Error (deg)25.72 | 12 | |
| Articulated Object Joint Estimation | Real world dataset Unseen categories 1.0 | Axis Orientation Error (°)28.22 | 6 | |
| Geometry Reconstruction | Shape2Motion | Whole Chamfer Distance0.9 | 6 | |
| Articulation Estimation | Shape2Motion | Prismatic Angle Error1.36 | 6 | |
| Geometry Reconstruction | Synthetic dataset | Whole Chamfer Distance0.54 | 4 | |
| Articulation Estimation | Synthetic dataset | Prismatic Angle Error0.69 | 3 |