Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Prompt for Extraction? PAIE: Prompting Argument Interaction for Event Argument Extraction

About

In this paper, we propose an effective yet efficient model PAIE for both sentence-level and document-level Event Argument Extraction (EAE), which also generalizes well when there is a lack of training data. On the one hand, PAIE utilizes prompt tuning for extractive objectives to take the best advantages of Pre-trained Language Models (PLMs). It introduces two span selectors based on the prompt to select start/end tokens among input texts for each role. On the other hand, it captures argument interactions via multi-role prompts and conducts joint optimization with optimal span assignments via a bipartite matching loss. Also, with a flexible prompt design, PAIE can extract multiple arguments with the same role instead of conventional heuristic threshold tuning. We have conducted extensive experiments on three benchmarks, including both sentence- and document-level EAE. The results present promising improvements from PAIE (3.5\% and 2.3\% F1 gains in average on three benchmarks, for PAIE-base and PAIE-large respectively). Further analysis demonstrates the efficiency, generalization to few-shot settings, and effectiveness of different extractive prompt tuning strategies. Our code is available at https://github.com/mayubo2333/PAIE.

Yubo Ma, Zehao Wang, Yixin Cao, Mukai Li, Meiqi Chen, Kun Wang, Jing Shao• 2022

Related benchmarks

TaskDatasetResultRank
Argument ClassificationACE05-E (test)
F1 Score72.1
63
Argument ClassificationACE05-E (dev)
F1 Score74.1
48
Argument identification and classificationACE05-E (dev)
Arg-I Score78.5
48
Argument identification and classificationACE05-E (test)
Arg-I Score75
48
Argument ClassificationWikiEvents (test)
Head F168.4
23
Event Argument ExtractionWikiEvents (test)
Arg-C65.3
15
Event Argument ExtractionRAMS
Arg-C52.2
14
Document-level Event Argument ExtractionRAMS (test)
Span F152.2
13
Event Argument ExtractionACE05
Arg-I75.7
10
Event Argument ExtractionWIKIEVENTS
Arg-C Score65.3
9
Showing 10 of 12 rows

Other info

Code

Follow for update