Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Hyperbolic Entailment Cones for Learning Hierarchical Embeddings

About

Learning graph representations via low-dimensional embeddings that preserve relevant network properties is an important class of problems in machine learning. We here present a novel method to embed directed acyclic graphs. Following prior work, we first advocate for using hyperbolic spaces which provably model tree-like structures better than Euclidean geometry. Second, we view hierarchical relations as partial orders defined using a family of nested geodesically convex cones. We prove that these entailment cones admit an optimal shape with a closed form expression both in the Euclidean and hyperbolic spaces, and they canonically define the embedding learning process. Experiments show significant improvements of our method over strong recent baselines both in terms of representational capacity and generalization.

Octavian-Eugen Ganea, Gary B\'ecigneul, Thomas Hofmann• 2018

Related benchmarks

TaskDatasetResultRank
Link PredictionWordNet noun hierarchy (transitive closure) (test)
F194.4
40
Transitive reasoningMammal
F1 Score56.3
18
Transitive reasoningWordNet Noun
F1 Score32.1
18
Transitive reasoningMCG
F1 Score25.5
18
Transitive reasoningHearst
F1 Score23.7
18
Multi-hop InferenceWordNet (test)
Precision (RN)81.7
12
Subtree ClassificationWordNet mammal.n.01 (test)
F1 Score94
10
Subtree ClassificationWordNet animal.n.01 (test)
F1 Score96
10
Subtree ClassificationWordNet worker.n.01 (test)
F1 Score84
10
Subtree ClassificationWordNet group.n.01 (test)
F1 Score86
10
Showing 10 of 30 rows

Other info

Code

Follow for update