Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Entity-Relation Extraction as Multi-Turn Question Answering

About

In this paper, we propose a new paradigm for the task of entity-relation extraction. We cast the task as a multi-turn question answering problem, i.e., the extraction of entities and relations is transformed to the task of identifying answer spans from the context. This multi-turn QA formalization comes with several key advantages: firstly, the question query encodes important information for the entity/relation class we want to identify; secondly, QA provides a natural way of jointly modeling entity and relation; and thirdly, it allows us to exploit the well developed machine reading comprehension (MRC) models. Experiments on the ACE and the CoNLL04 corpora demonstrate that the proposed paradigm significantly outperforms previous best models. We are able to obtain the state-of-the-art results on all of the ACE04, ACE05 and CoNLL04 datasets, increasing the SOTA results on the three datasets to 49.4 (+1.0), 60.2 (+0.6) and 68.9 (+2.1), respectively. Additionally, we construct a newly developed dataset RESUME in Chinese, which requires multi-step reasoning to construct entity dependencies, as opposed to the single-step dependency extraction in the triplet exaction in previous datasets. The proposed multi-turn QA model also achieves the best performance on the RESUME dataset.

Xiaoya Li, Fan Yin, Zijun Sun, Xiayu Li, Arianna Yuan, Duo Chai, Mingxin Zhou, Jiwei Li• 2019

Related benchmarks

TaskDatasetResultRank
Relation ExtractionACE05 (test)
F1 Score60.2
72
Entity extractionACE05 (test)
F1 Score84.8
53
Relation ExtractionCoNLL04 (test)
F1 Score68.9
28
Entity ClassificationCoNLL04 (test)
F1 Score87.8
21
Relation ExtractionACE04 (test)
F1 Score49.4
21
Entity extractionACE04 (test)
F1 Score83.6
19
Named Entity RecognitionCoNLL04 (test)
F1 Score87.8
16
Entity extractionRESUME--
11
End-to-end Relation ExtractionACE04 (5-fold)
Ent Score83.6
10
Named Entity RecognitionACE 05
Micro-F184.8
8
Showing 10 of 14 rows

Other info

Follow for update