Hyperbolic Entailment Cones for Learning Hierarchical Embeddings
About
Learning graph representations via low-dimensional embeddings that preserve relevant network properties is an important class of problems in machine learning. We here present a novel method to embed directed acyclic graphs. Following prior work, we first advocate for using hyperbolic spaces which provably model tree-like structures better than Euclidean geometry. Second, we view hierarchical relations as partial orders defined using a family of nested geodesically convex cones. We prove that these entailment cones admit an optimal shape with a closed form expression both in the Euclidean and hyperbolic spaces, and they canonically define the embedding learning process. Experiments show significant improvements of our method over strong recent baselines both in terms of representational capacity and generalization.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Link Prediction | WordNet noun hierarchy (transitive closure) (test) | F194.4 | 40 | |
| Multi-hop Inference | WordNet (test) | Precision (RN)81.7 | 12 | |
| Subtree Classification | WordNet mammal.n.01 (test) | F1 Score94 | 10 | |
| Subtree Classification | WordNet animal.n.01 (test) | F1 Score96 | 10 | |
| Subtree Classification | WordNet worker.n.01 (test) | F1 Score84 | 10 | |
| Subtree Classification | WordNet group.n.01 (test) | F1 Score86 | 10 | |
| Transfer Mixed-hop Prediction (SNOMED → FoodOn) | FoodOn (test) | Precision (Random Negatives)19.2 | 8 | |
| Ancestor-descendant prediction | DDB14 100% inferred descendant pairs | mAP59.4 | 6 | |
| Ancestor-descendant prediction | DDB14 50% inferred descendant pairs | AUROC77.3 | 6 | |
| Ancestor-descendant prediction | DDB14 100% inferred descendant pairs | AUROC56 | 6 |