Unified Structure Generation for Universal Information Extraction
About
Information extraction suffers from its varying targets, heterogeneous structures, and demand-specific schemas. In this paper, we propose a unified text-to-structure generation framework, namely UIE, which can universally model different IE tasks, adaptively generate targeted structures, and collaboratively learn general IE abilities from different knowledge sources. Specifically, UIE uniformly encodes different extraction structures via a structured extraction language, adaptively generates target extractions via a schema-based prompt mechanism - structural schema instructor, and captures the common IE abilities via a large-scale pre-trained text-to-structure model. Experiments show that UIE achieved the state-of-the-art performance on 4 IE tasks, 13 datasets, and on all supervised, low-resource, and few-shot settings for a wide range of entity, relation, event and sentiment extraction tasks and their unification. These results verified the effectiveness, universality, and transferability of UIE.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Named Entity Recognition | CoNLL 2003 (test) | F1 Score92.99 | 539 | |
| Nested Named Entity Recognition | ACE 2005 (test) | F1 Score85.78 | 153 | |
| Named Entity Recognition | CoNLL 03 | F1 (Entity)92.99 | 102 | |
| Relation Extraction | CONLL04 | Relation Strict F175 | 43 | |
| aspect sentiment triplet extraction | Rest SemEval 2014 (test) | F1 Score72.55 | 40 | |
| Named Entity Recognition | ACE05 | F1 Score85.78 | 38 | |
| Named Entity Recognition | ACE04 (test) | F1 Score86.89 | 36 | |
| aspect sentiment triplet extraction | Rest SemEval 2016 (test) | -- | 34 | |
| Relation Extraction | CoNLL04 (test) | F1 Score75 | 28 | |
| Relation Extraction | SciERC | Relation Strict F136.53 | 28 |