Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Complex Temporal Question Answering on Knowledge Graphs

About

Question answering over knowledge graphs (KG-QA) is a vital topic in IR. Questions with temporal intent are a special class of practical importance, but have not received much attention in research. This work presents EXAQT, the first end-to-end system for answering complex temporal questions that have multiple entities and predicates, and associated temporal conditions. EXAQT answers natural language questions over KGs in two stages, one geared towards high recall, the other towards precision at top ranks. The first step computes question-relevant compact subgraphs within the KG, and judiciously enhances them with pertinent temporal facts, using Group Steiner Trees and fine-tuned BERT models. The second step constructs relational graph convolutional networks (R-GCNs) from the first step's output, and enhances the R-GCNs with time-aware entity embeddings and attention over temporal relations. We evaluate EXAQT on TimeQuestions, a large dataset of 16k temporal questions we compiled from a variety of general purpose KG-QA benchmarks. Results show that EXAQT outperforms three state-of-the-art systems for answering complex questions over KGs, thereby justifying specialized treatment of temporal QA.

Zhen Jia, Soumajit Pramanik, Rishiraj Saha Roy, Gerhard Weikum• 2021

Related benchmarks

TaskDatasetResultRank
Temporal Knowledge Graph Question AnsweringTimeQuestions (test)
Hits@1 (Overall)57.2
38
Temporal Question AnsweringTIME QUESTIONS 1.0 (test)
P@156.5
18
Temporal Question AnsweringTIQ 1.0 (test)
P@10.232
10
Medical Question AnsweringGenMedGPT-5k
BERTScore Precision77.17
7
Medical Question AnsweringExplainCPE (test)
Accuracy42
7
Explanation GenerationExplainCPE
BERTScore Precision93.54
6
Medical Dialogue Question AnsweringCMCQA (test)
BERTScore Precision93.18
6
Temporal Question AnsweringTimeQuestions (test)
P@1 (Overall)56.5
4
Temporal ReasoningTimeQuestions (test)
EM56.8
4
Knowledge Graph Question AnsweringLC-QuAD temporal 2.0
Hits@10.732
2
Showing 10 of 14 rows

Other info

Code

Follow for update