Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

SpanNER: Named Entity Re-/Recognition as Span Prediction

About

Recent years have seen the paradigm shift of Named Entity Recognition (NER) systems from sequence labeling to span prediction. Despite its preliminary effectiveness, the span prediction model's architectural bias has not been fully understood. In this paper, we first investigate the strengths and weaknesses when the span prediction model is used for named entity recognition compared with the sequence labeling framework and how to further improve it, which motivates us to make complementary advantages of systems based on different paradigms. We then reveal that span prediction, simultaneously, can serve as a system combiner to re-recognize named entities from different systems' outputs. We experimentally implement 154 systems on 11 datasets, covering three languages, comprehensive results show the effectiveness of span prediction models that both serve as base NER systems and system combiners. We make all code and datasets available: \url{https://github.com/neulab/spanner}, as well as an online system demo: \url{http://spanner.sh}. Our model also has been deployed into the ExplainaBoard platform, which allows users to flexibly perform a system combination of top-scoring systems in an interactive way: \url{http://explainaboard.nlpedia.ai/leaderboard/task-ner/}.

Jinlan Fu, Xuanjing Huang, Pengfei Liu• 2021

Related benchmarks

TaskDatasetResultRank
Named Entity RecognitionCoNLL 2003 (test)--
539
Named Entity RecognitionCoNLL Spanish NER 2002 (test)
F1 Score87.26
98
Named Entity RecognitionOntoNotes 5.0
F1 Score91.59
79
Named Entity RecognitionWnut 2017
F1 Score52.97
79
Named Entity RecognitionWNUT 2017 (test)
F1 Score51.83
63
Named Entity RecognitionWNUT 2016
F1 Score56.27
28
Zero-shot Triplet ExtractionWiki-ZSL (test)
Accuracy8.16
15
Zero-shot Triplet ExtractionFewRel (test)
Accuracy7.68
15
Named Entity RecognitionCoNLL BN
F1 Score90.93
12
Named Entity RecognitionOntoNotes WB 5.0
F1 Score68.58
12
Showing 10 of 24 rows

Other info

Code

Follow for update