Message Passing for Hyper-Relational Knowledge Graphs
About
Hyper-relational knowledge graphs (KGs) (e.g., Wikidata) enable associating additional key-value pairs along with the main triple to disambiguate, or restrict the validity of a fact. In this work, we propose a message passing based graph encoder - StarE capable of modeling such hyper-relational KGs. Unlike existing approaches, StarE can encode an arbitrary number of additional information (qualifiers) along with the main triple while keeping the semantic roles of qualifiers and triples intact. We also demonstrate that existing benchmarks for evaluating link prediction (LP) performance on hyper-relational KGs suffer from fundamental flaws and thus develop a new Wikidata-based dataset - WD50K. Our experiments demonstrate that StarE based LP model outperforms existing approaches across multiple benchmarks. We also confirm that leveraging qualifiers is vital for link prediction with gains up to 25 MRR points compared to triple-based representations.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Hyper-Relational Link Prediction | JFFI100 V2 | H/T Score0.2933 | 22 | |
| Hyper-Relational Link Prediction | JFFI100 V1 | H/T Metric33.36 | 22 | |
| Hyper-Relational Link Prediction | WD20K66 V2 | H/T Score33.67 | 19 | |
| Hyper-Relational Link Prediction | WD20K33 V1 | H/T Score0.2514 | 19 | |
| Hyper-Relational Link Prediction | WD20K100 V2 | H/T Ratio22.9 | 19 | |
| Hyper-Relational Link Prediction | WD20K66 V1 | MRR (H/T)0.0106 | 19 | |
| Hyper-Relational Link Prediction | JFFI V1 | MRR (H/T)0.0327 | 18 | |
| Hyper-Relational Link Prediction | WD20K100 V1 | -- | 15 | |
| Entity Prediction | WikiPeople subject object | MRR49.1 | 14 | |
| Entity Prediction | JF17K subject/object | MRR0.574 | 14 |