Joint Extraction of Entities and Relations Based on a Novel Tagging Scheme
About
Joint extraction of entities and relations is an important task in information extraction. To tackle this problem, we firstly propose a novel tagging scheme that can convert the joint extraction task to a tagging problem. Then, based on our tagging scheme, we study different end-to-end models to extract entities and their relations directly, without identifying entities and relations separately. We conduct experiments on a public dataset produced by distant supervision method and the experimental results show that the tagging based methods are better than most of the existing pipelined and joint learning methods. What's more, the end-to-end model proposed in this paper, achieves the best results on the public dataset.
Suncong Zheng, Feng Wang, Hongyun Bao, Yuexing Hao, Peng Zhou, Bo Xu• 2017
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Relation Extraction | NYT (test) | F1 Score42 | 85 | |
| Joint Entity and Relation Extraction | NYT (test) | Precision89 | 64 | |
| Relation Extraction | Wiki-KBP (test) | F1 Score38.7 | 59 | |
| Joint Entity and Relation Extraction | WebNLG (test) | Precision52.5 | 52 | |
| Relation Triple Extraction | WebNLG original (test) | F1 Score (%)28.3 | 33 | |
| Relation Extraction | NYT10 subset (test) | Precision59.3 | 20 | |
| Relational Triple Extraction | NYT standard (test) | F1 Score42 | 16 | |
| Relation Extraction | NYT HRL 11 | Precision46.9 | 14 | |
| Relation Extraction | NYT HRL 10 | Precision59.3 | 11 | |
| Relational Fact Extraction | WebNLG (test) | -- | 11 |
Showing 10 of 23 rows