Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

An Enhanced Span-based Decomposition Method for Few-Shot Sequence Labeling

About

Few-Shot Sequence Labeling (FSSL) is a canonical paradigm for the tagging models, e.g., named entity recognition and slot filling, to generalize on an emerging, resource-scarce domain. Recently, the metric-based meta-learning framework has been recognized as a promising approach for FSSL. However, most prior works assign a label to each token based on the token-level similarities, which ignores the integrality of named entities or slots. To this end, in this paper, we propose ESD, an Enhanced Span-based Decomposition method for FSSL. ESD formulates FSSL as a span-level matching problem between test query and supporting instances. Specifically, ESD decomposes the span matching problem into a series of span-level procedures, mainly including enhanced span representation, class prototype aggregation and span conflicts resolution. Extensive experiments show that ESD achieves the new state-of-the-art results on two popular FSSL benchmarks, FewNERD and SNIPS, and is proven to be more robust in the nested and noisy tagging scenarios. Our code is available at https://github.com/Wangpeiyi9979/ESD.

Peiyi Wang, Runxin Xu, Tianyu Liu, Qingyu Zhou, Yunbo Cao, Baobao Chang, Zhifang Sui• 2021

Related benchmarks

TaskDatasetResultRank
Named Entity RecognitionFew-NERD INTER 1.0 (test)
Average F174.14
62
Named Entity RecognitionFewNERD INTRA
F1 Score52.14
47
Few-shot Named Entity RecognitionFewNERD Intra 1.0
F1 Score50.68
44
Few-shot Named Entity RecognitionFew-NERD Intra (test)
F1 Score50.68
40
Few-shot Named Entity RecognitionFEW-NERD INTER
F1 Score74.14
24
Few-shot Named Entity RecognitionFewNERD Inter 1.0
F1 Score74.14
20
Named Entity RecognitionFew-NERD Arxiv V6 (test)
1-shot INTRA Score36.08
12
Slot FillingSNIPS 5-shot
We Score84.5
8
Slot FillingSNIPS 1-shot
Average Score70.44
6
Showing 9 of 9 rows

Other info

Code

Follow for update