An Enhanced Span-based Decomposition Method for Few-Shot Sequence Labeling
About
Few-Shot Sequence Labeling (FSSL) is a canonical paradigm for the tagging models, e.g., named entity recognition and slot filling, to generalize on an emerging, resource-scarce domain. Recently, the metric-based meta-learning framework has been recognized as a promising approach for FSSL. However, most prior works assign a label to each token based on the token-level similarities, which ignores the integrality of named entities or slots. To this end, in this paper, we propose ESD, an Enhanced Span-based Decomposition method for FSSL. ESD formulates FSSL as a span-level matching problem between test query and supporting instances. Specifically, ESD decomposes the span matching problem into a series of span-level procedures, mainly including enhanced span representation, class prototype aggregation and span conflicts resolution. Extensive experiments show that ESD achieves the new state-of-the-art results on two popular FSSL benchmarks, FewNERD and SNIPS, and is proven to be more robust in the nested and noisy tagging scenarios. Our code is available at https://github.com/Wangpeiyi9979/ESD.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Named Entity Recognition | Few-NERD INTER 1.0 (test) | Average F174.14 | 62 | |
| Named Entity Recognition | FewNERD INTRA | F1 Score52.14 | 47 | |
| Few-shot Named Entity Recognition | FewNERD Intra 1.0 | F1 Score50.68 | 44 | |
| Few-shot Named Entity Recognition | Few-NERD Intra (test) | F1 Score50.68 | 40 | |
| Few-shot Named Entity Recognition | FEW-NERD INTER | F1 Score74.14 | 24 | |
| Few-shot Named Entity Recognition | FewNERD Inter 1.0 | F1 Score74.14 | 20 | |
| Named Entity Recognition | Few-NERD Arxiv V6 (test) | 1-shot INTRA Score36.08 | 12 | |
| Slot Filling | SNIPS 5-shot | We Score84.5 | 8 | |
| Slot Filling | SNIPS 1-shot | Average Score70.44 | 6 |