Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

ProUIE: A Macro-to-Micro Progressive Learning Method for LLM-based Universal Information Extraction

About

LLM-based universal information extraction (UIE) methods often rely on additional information beyond the original training data, which increases training complexity yet often yields limited gains. To address this, we propose ProUIE, a Macro-to-Micro progressive learning approach that improves UIE without introducing any external information. ProUIE consists of three stages: (i) macro-level Complete Modeling (CM), which learns NER, RE, and EE along their intrinsic difficulty order on the full training data to build a unified extraction foundation, (ii) meso-level Streamlined Alignment (SA), which operates on sampled data with simplified target formats, streamlining and regularizing structured outputs to make them more concise and controllable, and (iii) micro-level Deep Exploration (DE), which applies GRPO with stepwise fine-grained rewards (SFR) over structural units to guide exploration and improve performance. Experiments on 36 public datasets show that ProUIE consistently improves unified extraction, outperforming strong instruction-tuned baselines on average for NER and RE while using a smaller backbone, and it further demonstrates clear gains in large-scale production-oriented information extraction.

Wenda Liu, Zhigang Song, Shuai Nie, Guangyao Liu, Lisung Chen, Binyu Yang, Yaran Chen, Peng Zhou, Hongzhen Wang, Yuchen Liu, Wenyue Hu, Jiaming Xu, Runyu Shi, Ying Huang• 2026

Related benchmarks

TaskDatasetResultRank
Named Entity RecognitionOntoNotes
F1-score88.33
102
Named Entity RecognitionCoNLL 03--
102
Named Entity RecognitionBC5CDR
F1 Score88.93
70
Named Entity RecognitiontweetNER7
Entity F166.44
49
Relation ExtractionSciERC
Relation Strict F146.76
48
Named Entity RecognitionWikiAnn
F1 Score83.47
40
Relation ExtractionCoNLL 04
F173.17
39
Named Entity RecognitionNCBI-disease
F1 Score86.95
37
Named Entity RecognitionACE 2005
Entity F186.15
30
Named Entity Recognitionbc2gm
Entity F183.87
29
Showing 10 of 37 rows

Other info

Follow for update