Universal Information Extraction as Unified Semantic Matching
About
The challenge of information extraction (IE) lies in the diversity of label schemas and the heterogeneity of structures. Traditional methods require task-specific model design and rely heavily on expensive supervision, making them difficult to generalize to new schemas. In this paper, we decouple IE into two basic abilities, structuring and conceptualizing, which are shared by different tasks and schemas. Based on this paradigm, we propose to universally model various IE tasks with Unified Semantic Matching (USM) framework, which introduces three unified token linking operations to model the abilities of structuring and conceptualizing. In this way, USM can jointly encode schema and input text, uniformly extract substructures in parallel, and controllably decode target structures on demand. Empirical evaluation on 4 IE tasks shows that the proposed method achieves state-of-the-art performance under the supervised experiments and shows strong generalization ability in zero/few-shot transfer settings.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Named Entity Recognition | CoNLL 03 | F1 (Entity)93.16 | 102 | |
| Relation Extraction | CONLL04 | Relation Strict F178.84 | 43 | |
| Relation Extraction | SciERC | Relation Strict F137.4 | 28 | |
| Relation Extraction | CoNLL 04 | F178.8 | 24 | |
| Named Entity Recognition | Cross-domain NER datasets out-of-domain | AI NER Score28.2 | 23 | |
| Named Entity Recognition | ACE 2005 | Entity F187.14 | 22 | |
| Event Argument Extraction | ACE 2005 | F1 Score55.83 | 16 | |
| Event Detection | ACE 2005 (test) | F1 Score69.3 | 15 | |
| Event Argument Extraction | CASIE | F1 Score63.26 | 12 | |
| Event Argument Extraction | ACE 2005 (test) | F1 Score63.3 | 11 |