Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Local-Global History-aware Contrastive Learning for Temporal Knowledge Graph Reasoning

About

Temporal knowledge graphs (TKGs) have been identified as a promising approach to represent the dynamics of facts along the timeline. The extrapolation of TKG is to predict unknowable facts happening in the future, holding significant practical value across diverse fields. Most extrapolation studies in TKGs focus on modeling global historical fact repeating and cyclic patterns, as well as local historical adjacent fact evolution patterns, showing promising performance in predicting future unknown facts. Yet, existing methods still face two major challenges: (1) They usually neglect the importance of historical information in KG snapshots related to the queries when encoding the local and global historical information; (2) They exhibit weak anti-noise capabilities, which hinders their performance when the inputs are contaminated with noise.To this end, we propose a novel \blue{Lo}cal-\blue{g}lobal history-aware \blue{C}ontrastive \blue{L}earning model (\blue{LogCL}) for TKG reasoning, which adopts contrastive learning to better guide the fusion of local and global historical information and enhance the ability to resist interference. Specifically, for the first challenge, LogCL proposes an entity-aware attention mechanism applied to the local and global historical facts encoder, which captures the key historical information related to queries. For the latter issue, LogCL designs four historical query contrast patterns, effectively improving the robustness of the model. The experimental results on four benchmark datasets demonstrate that LogCL delivers better and more robust performance than the state-of-the-art baselines.

Wei Chen, Huaiyu Wan, Yuting Wu, Shuyuan Zhao, Jiayaqi Cheng, Yuxin Li, Youfang Lin• 2023

Related benchmarks

TaskDatasetResultRank
Temporal Knowledge Graph reasoningICEWS 18
Hits@100.5774
60
Temporal Knowledge Graph reasoningICEWS 14
Hits@137.8
48
Temporal Knowledge Graph Extrapolation ReasoningGDELT
MRR23.8
28
Unseen event predictionICEWS14 (test)
MRR0.2919
28
Temporal Knowledge Graph ForecastingICEWS 05-15
MRR57
20
Temporal Knowledge Graph ForecastingICEWS 18
MRR0.357
20
Temporal Knowledge Graph ForecastingICEWS18 (test)
Hits@10.1174
16
Temporal Knowledge Graph Extrapolation ReasoningICEWS 05-15
MRR57.04
11
Showing 8 of 8 rows

Other info

Follow for update