Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Decomposed Meta-Learning for Few-Shot Named Entity Recognition

About

Few-shot named entity recognition (NER) systems aim at recognizing novel-class named entities based on only a few labeled examples. In this paper, we present a decomposed meta-learning approach which addresses the problem of few-shot NER by sequentially tackling few-shot span detection and few-shot entity typing using meta-learning. In particular, we take the few-shot span detection as a sequence labeling problem and train the span detector by introducing the model-agnostic meta-learning (MAML) algorithm to find a good model parameter initialization that could fast adapt to new entity classes. For few-shot entity typing, we propose MAML-ProtoNet, i.e., MAML-enhanced prototypical networks to find a good embedding space that can better distinguish text span representations from different entity classes. Extensive experiments on various benchmarks show that our approach achieves superior performance over prior methods.

Tingting Ma, Huiqiang Jiang, Qianhui Wu, Tiejun Zhao, Chin-Yew Lin• 2022

Related benchmarks

TaskDatasetResultRank
Named Entity RecognitionFew-NERD INTER 1.0 (test)
Average F171.62
62
Named Entity RecognitionFewNERD INTRA
F1 Score62.92
47
Few-shot Named Entity RecognitionFewNERD Intra 1.0
F1 Score63.23
44
Few-shot Named Entity RecognitionFew-NERD Intra (test)
F1 Score63.23
40
Named Entity RecognitionOntoNotes to I2B2, CoNLL, WNUT, GUM 5.0 (test)
I2B2 Score19.8
26
Few-shot Named Entity RecognitionFEW-NERD INTER
F1 Score71.62
24
Named Entity RecognitionNews
F1 Score58.18
21
Few-shot Named Entity RecognitionFewNERD Inter 1.0
F1 Score71.62
20
Named Entity RecognitionWiki
F1 Score31.36
12
Named Entity RecognitionSocial
F1 Score31.02
12
Showing 10 of 16 rows

Other info

Code

Follow for update