Decomposed Meta-Learning for Few-Shot Named Entity Recognition
About
Few-shot named entity recognition (NER) systems aim at recognizing novel-class named entities based on only a few labeled examples. In this paper, we present a decomposed meta-learning approach which addresses the problem of few-shot NER by sequentially tackling few-shot span detection and few-shot entity typing using meta-learning. In particular, we take the few-shot span detection as a sequence labeling problem and train the span detector by introducing the model-agnostic meta-learning (MAML) algorithm to find a good model parameter initialization that could fast adapt to new entity classes. For few-shot entity typing, we propose MAML-ProtoNet, i.e., MAML-enhanced prototypical networks to find a good embedding space that can better distinguish text span representations from different entity classes. Extensive experiments on various benchmarks show that our approach achieves superior performance over prior methods.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Named Entity Recognition | Few-NERD INTER 1.0 (test) | Average F171.62 | 62 | |
| Named Entity Recognition | FewNERD INTRA | F1 Score62.92 | 47 | |
| Few-shot Named Entity Recognition | FewNERD Intra 1.0 | F1 Score63.23 | 44 | |
| Few-shot Named Entity Recognition | Few-NERD Intra (test) | F1 Score63.23 | 40 | |
| Named Entity Recognition | OntoNotes to I2B2, CoNLL, WNUT, GUM 5.0 (test) | I2B2 Score19.8 | 26 | |
| Few-shot Named Entity Recognition | FEW-NERD INTER | F1 Score71.62 | 24 | |
| Named Entity Recognition | News | F1 Score58.18 | 21 | |
| Few-shot Named Entity Recognition | FewNERD Inter 1.0 | F1 Score71.62 | 20 | |
| Named Entity Recognition | Wiki | F1 Score31.36 | 12 | |
| Named Entity Recognition | Social | F1 Score31.02 | 12 |