Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Unified Structure Generation for Universal Information Extraction

About

Information extraction suffers from its varying targets, heterogeneous structures, and demand-specific schemas. In this paper, we propose a unified text-to-structure generation framework, namely UIE, which can universally model different IE tasks, adaptively generate targeted structures, and collaboratively learn general IE abilities from different knowledge sources. Specifically, UIE uniformly encodes different extraction structures via a structured extraction language, adaptively generates target extractions via a schema-based prompt mechanism - structural schema instructor, and captures the common IE abilities via a large-scale pre-trained text-to-structure model. Experiments show that UIE achieved the state-of-the-art performance on 4 IE tasks, 13 datasets, and on all supervised, low-resource, and few-shot settings for a wide range of entity, relation, event and sentiment extraction tasks and their unification. These results verified the effectiveness, universality, and transferability of UIE.

Yaojie Lu, Qing Liu, Dai Dai, Xinyan Xiao, Hongyu Lin, Xianpei Han, Le Sun, Hua Wu• 2022

Related benchmarks

TaskDatasetResultRank
Named Entity RecognitionCoNLL 2003 (test)
F1 Score92.99
539
Nested Named Entity RecognitionACE 2005 (test)
F1 Score85.78
153
Named Entity RecognitionCoNLL 03
F1 (Entity)92.99
102
Relation ExtractionCONLL04
Relation Strict F175
43
aspect sentiment triplet extractionRest SemEval 2014 (test)
F1 Score72.55
40
Named Entity RecognitionACE05
F1 Score85.78
38
Named Entity RecognitionACE04 (test)
F1 Score86.89
36
aspect sentiment triplet extractionRest SemEval 2016 (test)--
34
Relation ExtractionCoNLL04 (test)
F1 Score75
28
Relation ExtractionSciERC
Relation Strict F136.53
28
Showing 10 of 41 rows

Other info

Code

Follow for update