Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Summarization as Indirect Supervision for Relation Extraction

About

Relation extraction (RE) models have been challenged by their reliance on training data with expensive annotations. Considering that summarization tasks aim at acquiring concise expressions of synoptical information from the longer context, these tasks naturally align with the objective of RE, i.e., extracting a kind of synoptical information that describes the relation of entity mentions. We present SuRE, which converts RE into a summarization formulation. SuRE leads to more precise and resource-efficient RE based on indirect supervision from summarization tasks. To achieve this goal, we develop sentence and relation conversion techniques that essentially bridge the formulation of summarization and RE tasks. We also incorporate constraint decoding techniques with Trie scoring to further enhance summarization-based RE with robust inference. Experiments on three RE datasets demonstrate the effectiveness of SuRE in both full-dataset and low-resource settings, showing that summarization is a promising source of indirect supervision to improve RE models.

Keming Lu, I-Hung Hsu, Wenxuan Zhou, Mingyu Derek Ma, Muhao Chen• 2022

Related benchmarks

TaskDatasetResultRank
Relation ExtractionTACRED (test)
F1 Score21.8
194
Relation ExtractionSemEval (test)
Micro F10.00e+0
55
Relation ExtractionTACREV (test)
F1 Score22.2
27
Relation ExtractionTACRED v1.0 (5% train)
Micro F10.653
19
Relation ExtractionRETACRED (test)
Precision17.9
17
Relation ExtractionTACRED v1.0 (full)
Micro F175.1
16
Relation ExtractionTACRED v1.0 (10% train)
Micro F170.7
13
Relation ExtractionTACRED 1% v1.0 (train)
Micro F152
13
Relation ExtractionTACREV v1.0 (full)
Micro F10.833
9
Relation ExtractionSemEval-2010 Task 8 (test)
Macro F189.7
8
Showing 10 of 10 rows

Other info

Code

Follow for update