Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

DEGREE: A Data-Efficient Generation-Based Event Extraction Model

About

Event extraction requires high-quality expert human annotations, which are usually expensive. Therefore, learning a data-efficient event extraction model that can be trained with only a few labeled examples has become a crucial challenge. In this paper, we focus on low-resource end-to-end event extraction and propose DEGREE, a data-efficient model that formulates event extraction as a conditional generation problem. Given a passage and a manually designed prompt, DEGREE learns to summarize the events mentioned in the passage into a natural sentence that follows a predefined pattern. The final event predictions are then extracted from the generated sentence with a deterministic algorithm. DEGREE has three advantages to learn well with less training data. First, our designed prompts provide semantic guidance for DEGREE to leverage DEGREE and thus better capture the event arguments. Moreover, DEGREE is capable of using additional weakly-supervised information, such as the description of events encoded in the prompts. Finally, DEGREE learns triggers and arguments jointly in an end-to-end manner, which encourages the model to better utilize the shared knowledge and dependencies among them. Our experimental results demonstrate the strong performance of DEGREE for low-resource event extraction.

I-Hung Hsu, Kuan-Hao Huang, Elizabeth Boschee, Scott Miller, Prem Natarajan, Kai-Wei Chang, Nanyun Peng• 2021

Related benchmarks

TaskDatasetResultRank
Argument ClassificationACE05-E (test)
F1 Score73
63
Argument identification and classificationACE05-E (test)
Arg-I Score75.6
48
Argument ClassificationACE05-E (dev)
F1 Score73.8
48
Argument identification and classificationACE05-E (dev)
Arg-I Score78.4
48
Argument ClassificationERE-EN (test)
F1 Score74.9
46
Argument ClassificationERE-EN (dev)
F1 Score73.3
42
Argument identification and classificationERE-EN (test)
Arg-I Performance78.2
42
Argument identification and classificationERE-EN (dev)
Arg-I77.4
42
Event extractionACE05 Evt
Event Trigger F170.9
26
Event DetectionACE05 2-shot (test)
F1 Score40
13
Showing 10 of 20 rows

Other info

Follow for update