Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

RelationPrompt: Leveraging Prompts to Generate Synthetic Data for Zero-Shot Relation Triplet Extraction

About

Despite the importance of relation extraction in building and representing knowledge, less research is focused on generalizing to unseen relations types. We introduce the task setting of Zero-Shot Relation Triplet Extraction (ZeroRTE) to encourage further research in low-resource relation extraction methods. Given an input sentence, each extracted triplet consists of the head entity, relation label, and tail entity where the relation label is not seen at the training stage. To solve ZeroRTE, we propose to synthesize relation examples by prompting language models to generate structured texts. Concretely, we unify language model prompts and structured text approaches to design a structured prompt template for generating synthetic relation samples when conditioning on relation label prompts (RelationPrompt). To overcome the limitation for extracting multiple relation triplets in a sentence, we design a novel Triplet Search Decoding method. Experiments on FewRel and Wiki-ZSL datasets show the efficacy of RelationPrompt for the ZeroRTE task and zero-shot relation classification. Our code and data are available at github.com/declare-lab/RelationPrompt.

Yew Ken Chia, Lidong Bing, Soujanya Poria, Luo Si• 2022

Related benchmarks

TaskDatasetResultRank
Relational Triplet Extraction (RTE)NYC
GPT Accuracy12
32
Relational Triplet Extraction (RTE)CHI
GPT Accuracy21
32
Relation ClassificationFewRel (test)
Precision0.9015
22
Relation ClassificationWiki-ZSL (test)
Precision (%)70.66
22
Zero-shot Triplet ExtractionWiki-ZSL (test)
Accuracy16.74
15
Zero-shot Triplet ExtractionFewRel (test)
Accuracy24.36
15
Relation Triplet ExtractionWiki-ZSL (test)
Accuracy16.64
12
Relation Triplet ExtractionFewRel (test)
Accuracy23.18
12
Zero-shot Relation ExtractionFewRel m=15 (test)
Precision74.33
7
Zero-shot Relation ExtractionWiki-ZSL m=15 (test)
Precision (%)63.69
7
Showing 10 of 14 rows

Other info

Code

Follow for update