Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

YAYI-UIE: A Chat-Enhanced Instruction Tuning Framework for Universal Information Extraction

About

The difficulty of the information extraction task lies in dealing with the task-specific label schemas and heterogeneous data structures. Recent work has proposed methods based on large language models to uniformly model different information extraction tasks. However, these existing methods are deficient in their information extraction capabilities for Chinese languages other than English. In this paper, we propose an end-to-end chat-enhanced instruction tuning framework for universal information extraction (YAYI-UIE), which supports both Chinese and English. Specifically, we utilize dialogue data and information extraction data to enhance the information extraction performance jointly. Experimental results show that our proposed framework achieves state-of-the-art performance on Chinese datasets while also achieving comparable performance on English datasets under both supervised settings and zero-shot settings.

Xinglin Xiao, Yijie Wang, Nan Xu, Yuqi Wang, Hanxuan Yang, Minzheng Wang, Yin Luo, Lei Wang, Wenji Mao, Daniel Zeng• 2023

Related benchmarks

TaskDatasetResultRank
Named Entity RecognitionOntoNotes
F1-score87.04
91
Named Entity RecognitionConll 2003
F1 Score96.77
86
Named Entity RecognitionWnut 2017
F1 Score53.7
79
Named Entity RecognitionBC5CDR
F1 Score83.67
59
Named Entity RecognitionMIT Restaurant--
50
Named Entity RecognitionACE05
F1 Score81.78
38
Named Entity RecognitionGENIA
F1 Score75.21
37
Named Entity RecognitionWikiAnn
F1 Score72.63
32
Named Entity RecognitionMSRA
F1 Score95.97
29
Relation ExtractionSciERC
Relation Strict F140.94
28
Showing 10 of 68 rows

Other info

Follow for update