Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Entity, Relation, and Event Extraction with Contextualized Span Representations

About

We examine the capabilities of a unified, multi-task framework for three information extraction tasks: named entity recognition, relation extraction, and event extraction. Our framework (called DyGIE++) accomplishes all tasks by enumerating, refining, and scoring text spans designed to capture local (within-sentence) and global (cross-sentence) context. Our framework achieves state-of-the-art results across all tasks, on four datasets from a variety of domains. We perform experiments comparing different techniques to construct span representations. Contextualized embeddings like BERT perform well at capturing relationships among entities in the same or adjacent sentences, while dynamic span graph updates model long-range cross-sentence relationships. For instance, propagating span representations via predicted coreference links can enable the model to disambiguate challenging entity mentions. Our code is publicly available at https://github.com/dwadden/dygiepp and can be easily adapted for new tasks or datasets.

David Wadden, Ulme Wennberg, Yi Luan, Hannaneh Hajishirzi• 2019

Related benchmarks

TaskDatasetResultRank
Relation ExtractionACE05 (test)
F1 Score63.4
72
Argument ClassificationACE05-E (test)
F1 Score57.4
63
Named Entity RecognitionBC5CDR
F1 Score85.44
59
Named Entity RecognitionACE 2005 (test)
F1 Score88.6
58
Entity extractionACE05 (test)
F1 Score88.6
53
Argument identification and classificationACE05-E (test)
Arg-I Score63.6
48
Argument identification and classificationACE05-E (dev)
Arg-I Score67.2
48
Argument ClassificationACE05-E (dev)
F1 Score60
48
Argument ClassificationERE-EN (test)
F1 Score56
46
Argument identification and classificationERE-EN (dev)
Arg-I63.8
42
Showing 10 of 30 rows

Other info

Code

Follow for update