Text-Augmented Open Knowledge Graph Completion via Pre-Trained Language Models
About
The mission of open knowledge graph (KG) completion is to draw new findings from known facts. Existing works that augment KG completion require either (1) factual triples to enlarge the graph reasoning space or (2) manually designed prompts to extract knowledge from a pre-trained language model (PLM), exhibiting limited performance and requiring expensive efforts from experts. To this end, we propose TAGREAL that automatically generates quality query prompts and retrieves support information from large text corpora to probe knowledge from PLM for KG completion. The results show that TAGREAL achieves state-of-the-art performance on two benchmark datasets. We find that TAGREAL has superb performance even with limited training data, outperforming existing embedding-based, graph-based, and PLM-based methods.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Knowledge Graph Completion | FB60K-NYT10 20% training ratio (test) | Hits@545.59 | 13 | |
| Knowledge Graph Completion | FB60K-NYT10 50% training ratio (test) | Hits@548.98 | 13 | |
| Knowledge Graph Completion | UMLS-PubMed (20%) | Hits@535.83 | 13 | |
| Knowledge Graph Completion | UMLS-PubMed (40%) | Hits@546.26 | 13 | |
| Knowledge Graph Completion | UMLS-PubMed (70%) | Hits@553.46 | 13 | |
| Knowledge Graph Completion | FB60K-NYT10 100% training ratio (test) | Hits@550.85 | 13 | |
| Knowledge Graph Completion | UMLS-PubMed (100%) | Hits@560.68 | 12 |