Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

SCIR: A Self-Correcting Iterative Refinement Framework for Enhanced Information Extraction Based on Schema

About

Although Large language Model (LLM)-powered information extraction (IE) systems have shown impressive capabilities, current fine-tuning paradigms face two major limitations: high training costs and difficulties in aligning with LLM preferences. To address these issues, we propose a novel universal IE paradigm, the Self-Correcting Iterative Refinement (SCIR) framework, along with a Multi-task Bilingual (Chinese-English) Self-Correcting (MBSC) dataset containing over 100,000 entries. The SCIR framework achieves plug-and-play compatibility with existing LLMs and IE systems through its Dual-Path Self-Correcting module and feedback-driven optimization, thereby significantly reducing training costs. Concurrently, the MBSC dataset tackles the challenge of preference alignment by indirectly distilling GPT-4's capabilities into IE result detection models. Experimental results demonstrate that SCIR outperforms state-of-the-art IE methods across three key tasks: named entity recognition, relation extraction, and event extraction, achieving a 5.27 percent average improvement in span-based Micro-F1 while reducing training costs by 87 percent compared to baseline approaches. These advancements not only enhance the flexibility and accuracy of IE systems but also pave the way for lightweight and efficient IE paradigms.

Yushen Fang, Jianjun Li, Mingqian Ding, Chang Liu, Xinchi Zou, Wenqi Yang• 2025

Related benchmarks

TaskDatasetResultRank
Relation ExtractionWiki-ZSL (test)
Micro-F153.71
16
Relation ExtractionFewRel (test)
Micro-F155.02
16
Event extractionRAMS (test)
Micro-F127.04
13
Event extractionWikiEvents (test)
Micro-F145.74
13
Named Entity RecognitionCrossNER (test)
Micro-F165.54
13
Event extractionCCF Law and FewFC (test)
CCF Law Score67.01
11
Named Entity RecognitionWeibo and Boson (test)
Weibo NER Score41.35
11
Relation ExtractionCOAE2016 and SKE2020 (test)
COAE2016 Performance54.26
11
Showing 8 of 8 rows

Other info

Follow for update