MI-HGNN: Morphology-Informed Heterogeneous Graph Neural Network for Legged Robot Contact Perception
About
We present a Morphology-Informed Heterogeneous Graph Neural Network (MI-HGNN) for learning-based contact perception. The architecture and connectivity of the MI-HGNN are constructed from the robot morphology, in which nodes and edges are robot joints and links, respectively. By incorporating the morphology-informed constraints into a neural network, we improve a learning-based approach using model-based knowledge. We apply the proposed MI-HGNN to two contact perception problems, and conduct extensive experiments using both real-world and simulated data collected using two quadruped robots. Our experiments demonstrate the superiority of our method in terms of effectiveness, generalization ability, model efficiency, and sample efficiency. Our MI-HGNN improved the performance of a state-of-the-art model that leverages robot morphological symmetry by 8.4% with only 0.21% of its parameters. Although MI-HGNN is applied to contact perception problems for legged robots in this work, it can be seamlessly applied to other types of multi-body dynamical systems and has the potential to improve other robot learning frameworks. Our code is made publicly available at https://github.com/lunarlab-gatech/Morphology-Informed-HGNN.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Contact estimation | MIXED (test) | Accuracy91.6 | 50 | |
| Centroidal momentum estimation | synthetic Solo dataset (test) | Linear Cosine Similarity0.9301 | 8 | |
| Contact State Detection | Mini-Cheetah real-world | F1 (Leg LF)93.2 | 6 | |
| Contact estimation | Unseen-radius sequence Simulation | Accuracy70 | 6 | |
| Robot Locomotion | Walk-to-One-Side Trot Isaac Gym (simulation) | RMSE0.678 | 4 | |
| Robot Locomotion | Walk-to-One-Side Pronk Isaac Gym (simulation) | RMSE2.781 | 4 | |
| 1D Ground Reaction Force Estimation | Simulated A1 (Unseen Friction) | RMSE8.089 | 2 | |
| 1D Ground Reaction Force Estimation | Simulated A1 Unseen Speed | RMSE9.787 | 2 | |
| 1D Ground Reaction Force Estimation | Simulated A1 (Unseen Terrain) | RMSE8.826 | 2 | |
| 1D Ground Reaction Force Estimation | Simulated A1 (Unseen All) | RMSE10.245 | 2 |