Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Universal Information Extraction as Unified Semantic Matching

About

The challenge of information extraction (IE) lies in the diversity of label schemas and the heterogeneity of structures. Traditional methods require task-specific model design and rely heavily on expensive supervision, making them difficult to generalize to new schemas. In this paper, we decouple IE into two basic abilities, structuring and conceptualizing, which are shared by different tasks and schemas. Based on this paradigm, we propose to universally model various IE tasks with Unified Semantic Matching (USM) framework, which introduces three unified token linking operations to model the abilities of structuring and conceptualizing. In this way, USM can jointly encode schema and input text, uniformly extract substructures in parallel, and controllably decode target structures on demand. Empirical evaluation on 4 IE tasks shows that the proposed method achieves state-of-the-art performance under the supervised experiments and shows strong generalization ability in zero/few-shot transfer settings.

Jie Lou, Yaojie Lu, Dai Dai, Wei Jia, Hongyu Lin, Xianpei Han, Le Sun, Hua Wu• 2023

Related benchmarks

TaskDatasetResultRank
Named Entity RecognitionCoNLL 03
F1 (Entity)93.16
102
Relation ExtractionCONLL04
Relation Strict F178.84
43
Relation ExtractionSciERC
Relation Strict F137.4
28
Relation ExtractionCoNLL 04
F178.8
24
Named Entity RecognitionCross-domain NER datasets out-of-domain
AI NER Score28.2
23
Named Entity RecognitionACE 2005
Entity F187.14
22
Event Argument ExtractionACE 2005
F1 Score55.83
16
Event DetectionACE 2005 (test)
F1 Score69.3
15
Event Argument ExtractionCASIE
F1 Score63.26
12
Event Argument ExtractionACE 2005 (test)
F1 Score63.3
11
Showing 10 of 19 rows

Other info

Follow for update