Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Prompt for Extraction? PAIE: Prompting Argument Interaction for Event Argument Extraction

About

In this paper, we propose an effective yet efficient model PAIE for both sentence-level and document-level Event Argument Extraction (EAE), which also generalizes well when there is a lack of training data. On the one hand, PAIE utilizes prompt tuning for extractive objectives to take the best advantages of Pre-trained Language Models (PLMs). It introduces two span selectors based on the prompt to select start/end tokens among input texts for each role. On the other hand, it captures argument interactions via multi-role prompts and conducts joint optimization with optimal span assignments via a bipartite matching loss. Also, with a flexible prompt design, PAIE can extract multiple arguments with the same role instead of conventional heuristic threshold tuning. We have conducted extensive experiments on three benchmarks, including both sentence- and document-level EAE. The results present promising improvements from PAIE (3.5\% and 2.3\% F1 gains in average on three benchmarks, for PAIE-base and PAIE-large respectively). Further analysis demonstrates the efficiency, generalization to few-shot settings, and effectiveness of different extractive prompt tuning strategies. Our code is available at https://github.com/mayubo2333/PAIE.

Yubo Ma, Zehao Wang, Yixin Cao, Mukai Li, Meiqi Chen, Kun Wang, Jing Shao• 2022

Related benchmarks

TaskDatasetResultRank
Argument ClassificationACE05-E (test)
F1 Score72.1
63
Argument ClassificationACE05-E (dev)
F1 Score74.1
48
Argument identification and classificationACE05-E (dev)
Arg-I Score78.5
48
Argument identification and classificationACE05-E (test)
Arg-I Score75
48
Event Argument ExtractionWikiEvents RAMS2Wiki
Overall F120.15
26
Event Argument ExtractionWikiEvents Wiki2Wiki
Overall F124.42
26
Event Argument ExtractionRAMS RAMS2RAMS
Overall F130.8
26
Argument ClassificationWikiEvents (test)
Head F168.4
23
Event Argument ExtractionWikiEvents (test)
Arg-C65.3
15
Event Argument ExtractionRAMS
Arg-C52.2
14
Showing 10 of 15 rows

Other info

Code

Follow for update