Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Subgraph Retrieval Enhanced Model for Multi-hop Knowledge Base Question Answering

About

Recent works on knowledge base question answering (KBQA) retrieve subgraphs for easier reasoning. A desired subgraph is crucial as a small one may exclude the answer but a large one might introduce more noises. However, the existing retrieval is either heuristic or interwoven with the reasoning, causing reasoning on the partial subgraphs, which increases the reasoning bias when the intermediate supervision is missing. This paper proposes a trainable subgraph retriever (SR) decoupled from the subsequent reasoning process, which enables a plug-and-play framework to enhance any subgraph-oriented KBQA model. Extensive experiments demonstrate SR achieves significantly better retrieval and QA performance than existing retrieval methods. Via weakly supervised pre-training as well as the end-to-end fine-tuning, SRl achieves new state-of-the-art performance when combined with NSM, a subgraph-oriented reasoner, for embedding-based KBQA methods.

Jing Zhang, Xiaokang Zhang, Jifan Yu, Jian Tang, Jie Tang, Cuiping Li, Hong Chen• 2022

Related benchmarks

TaskDatasetResultRank
Knowledge Graph Question AnsweringCWQ
Hit@150.2
245
Knowledge Graph Question AnsweringWebQSP
Hit@169.5
209
Knowledge Graph Question AnsweringCWQ (test)
Hits@150.2
158
Knowledge Base Question AnsweringWEBQSP (test)
Hit@169.5
145
Multi-hop Knowledge Graph Question AnsweringWebQSP
Hits@168.9
90
Knowledge Graph Question AnsweringWEBQSP (test)
Hit69.5
85
Multi-hop Knowledge Graph Question AnsweringCWQ
Hits@150.2
84
Knowledge Base Question AnsweringWebQSP Freebase (test)
Hits@169.5
60
Knowledge Base Question AnsweringCWQ (test)
F1 Score47.1
44
Knowledge Base Question AnsweringCWQ Freebase (test)
Hits@150.2
38
Showing 10 of 13 rows

Other info

Follow for update