Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Prompt-Based Metric Learning for Few-Shot NER

About

Few-shot named entity recognition (NER) targets generalizing to unseen labels and/or domains with few labeled examples. Existing metric learning methods compute token-level similarities between query and support sets, but are not able to fully incorporate label semantics into modeling. To address this issue, we propose a simple method to largely improve metric learning for NER: 1) multiple prompt schemas are designed to enhance label semantics; 2) we propose a novel architecture to effectively combine multiple prompt-based representations. Empirically, our method achieves new state-of-the-art (SOTA) results under 16 of the 18 considered settings, substantially outperforming the previous SOTA by an average of 8.84% and a maximum of 34.51% in relative gains of micro F1. Our code is available at https://github.com/AChen-qaq/ProML.

Yanru Chen, Yanan Zheng, Zhilin Yang• 2022

Related benchmarks

TaskDatasetResultRank
Named Entity RecognitionCoNLL 03--
102
Named Entity RecognitionWnut 2017--
79
Named Entity RecognitionFewNERD INTRA--
47
Named Entity RecognitionGUM
Micro F136.99
36
Named Entity RecognitionCoNLL (test)--
28
Named Entity Recognitioni2b2 2014
Micro F1 Score0.5821
26
Named Entity RecognitionOntoNotes Onto-A 5.0
Micro F152.46
26
Named Entity RecognitionOntoNotes Onto-B 5.0
Micro-F169.69
26
Named Entity RecognitionOntoNotes Onto-C 5.0
Micro F167.58
26
Named Entity RecognitionFew-NERD Arxiv V6 (test)
1-shot INTRA Score56.49
12
Showing 10 of 13 rows

Other info

Code

Follow for update