Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

ZS4IE: A toolkit for Zero-Shot Information Extraction with simple Verbalizations

About

The current workflow for Information Extraction (IE) analysts involves the definition of the entities/relations of interest and a training corpus with annotated examples. In this demonstration we introduce a new workflow where the analyst directly verbalizes the entities/relations, which are then used by a Textual Entailment model to perform zero-shot IE. We present the design and implementation of a toolkit with a user interface, as well as experiments on four IE tasks that show that the system achieves very good performance at zero-shot learning using only 5--15 minutes per type of a user's effort. Our demonstration system is open-sourced at https://github.com/BBN-E/ZS4IE . A demonstration video is available at https://vimeo.com/676138340 .

Oscar Sainz, Haoling Qiu, Oier Lopez de Lacalle, Eneko Agirre, Bonan Min• 2022

Related benchmarks

TaskDatasetResultRank
Event extractionWikiEvents_EE
F1 Score10.4
5
Named Entity RecognitionWikiEvents NER
F1 Score49.1
5
Showing 2 of 2 rows

Other info

Follow for update