Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

YAYI-UIE: A Chat-Enhanced Instruction Tuning Framework for Universal Information Extraction

About

The difficulty of the information extraction task lies in dealing with the task-specific label schemas and heterogeneous data structures. Recent work has proposed methods based on large language models to uniformly model different information extraction tasks. However, these existing methods are deficient in their information extraction capabilities for Chinese languages other than English. In this paper, we propose an end-to-end chat-enhanced instruction tuning framework for universal information extraction (YAYI-UIE), which supports both Chinese and English. Specifically, we utilize dialogue data and information extraction data to enhance the information extraction performance jointly. Experimental results show that our proposed framework achieves state-of-the-art performance on Chinese datasets while also achieving comparable performance on English datasets under both supervised settings and zero-shot settings.

Xinglin Xiao, Yijie Wang, Nan Xu, Yuqi Wang, Hanxuan Yang, Minzheng Wang, Yin Luo, Lei Wang, Wenji Mao, Daniel Zeng• 2023

Related benchmarks

TaskDatasetResultRank
Named Entity RecognitionOntoNotes
F1-score87.04
121
Named Entity RecognitionBC5CDR
F1 Score83.67
102
Named Entity RecognitionWnut 2017
F1 Score53.7
91
Named Entity RecognitionConll 2003
F1 Score96.77
86
Named Entity RecognitionMIT Movie
Entity F170.14
71
Relation ExtractionSciERC
Relation Strict F140.94
68
Relation ExtractionCoNLL 04
F179.73
59
Named Entity RecognitionGENIA
F1 Score75.21
58
Named Entity RecognitionMIT Restaurant--
57
Named Entity RecognitionmultiNERD
Entity F188.42
50
Showing 10 of 68 rows

Other info

Follow for update