Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Unified Named Entity Recognition as Word-Word Relation Classification

About

So far, named entity recognition (NER) has been involved with three major types, including flat, overlapped (aka. nested), and discontinuous NER, which have mostly been studied individually. Recently, a growing interest has been built for unified NER, tackling the above three jobs concurrently with one single model. Current best-performing methods mainly include span-based and sequence-to-sequence models, where unfortunately the former merely focus on boundary identification and the latter may suffer from exposure bias. In this work, we present a novel alternative by modeling the unified NER as word-word relation classification, namely W^2NER. The architecture resolves the kernel bottleneck of unified NER by effectively modeling the neighboring relations between entity words with Next-Neighboring-Word (NNW) and Tail-Head-Word-* (THW-*) relations. Based on the W^2NER scheme we develop a neural framework, in which the unified NER is modeled as a 2D grid of word pairs. We then propose multi-granularity 2D convolutions for better refining the grid representations. Finally, a co-predictor is used to sufficiently reason the word-word relations. We perform extensive experiments on 14 widely-used benchmark datasets for flat, overlapped, and discontinuous NER (8 English and 6 Chinese datasets), where our model beats all the current top-performing baselines, pushing the state-of-the-art performances of unified NER.

Jingye Li, Hao Fei, Jiang Liu, Shengqiong Wu, Meishan Zhang, Chong Teng, Donghong Ji, Fei Li• 2021

Related benchmarks

TaskDatasetResultRank
Named Entity RecognitionCoNLL 2003 (test)
F1 Score93.07
539
Nested Named Entity RecognitionACE 2004 (test)
F1 Score87.52
166
Nested Named Entity RecognitionACE 2005 (test)
F1 Score86.79
153
Nested Named Entity RecognitionGENIA (test)
F1 Score85.23
140
Named Entity RecognitionCoNLL 03
F1 (Entity)93.07
102
Named Entity RecognitionOntoNotes
F1-score90.5
91
Named Entity RecognitionOntoNotes 5.0 (test)
F1 Score90.5
90
Named Entity RecognitionMSRA (test)
F1 Score96.1
63
Named Entity RecognitionACE 2005 (test)
F1 Score86.79
58
Named Entity RecognitionOntoNotes 4.0 (test)
F1 Score83.08
55
Showing 10 of 32 rows

Other info

Code

Follow for update