Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Named Entity Recognition with Bidirectional LSTM-CNNs

About

Named entity recognition is a challenging task that has traditionally required large amounts of knowledge in the form of feature engineering and lexicons to achieve high performance. In this paper, we present a novel neural network architecture that automatically detects word- and character-level features using a hybrid bidirectional LSTM and CNN architecture, eliminating the need for most feature engineering. We also propose a novel method of encoding partial lexicon matches in neural networks and compare it to existing approaches. Extensive evaluation shows that, given only tokenized text and publicly available word embeddings, our system is competitive on the CoNLL-2003 dataset and surpasses the previously reported state of the art performance on the OntoNotes 5.0 dataset by 2.13 F1 points. By using two lexicons constructed from publicly-available sources, we establish new state of the art performance with an F1 score of 91.62 on CoNLL-2003 and 86.28 on OntoNotes, surpassing systems that employ heavy feature engineering, proprietary lexicons, and rich entity linking information.

Jason P.C. Chiu, Eric Nichols• 2015

Related benchmarks

TaskDatasetResultRank
Named Entity RecognitionCoNLL 2003 (test)
F1 Score91.62
539
Named Entity RecognitionCoNLL English 2003 (test)
F1 Score91.62
135
Named Entity RecognitionOntoNotes
F1-score86.3
91
Named Entity RecognitionOntoNotes 5.0 (test)
F1 Score87.75
90
Named Entity RecognitionOntoNotes 5.0
F1 Score86.12
79
Named Entity RecognitionNER (test)
F1 Score91.62
68
Named Entity RecognitionWNUT 2017 (test)
F1 Score42.8
63
Named Entity RecognitionOntoNotes (test)
F1 Score86.28
34
Named Entity RecognitionCoNLL KB-Matching 2003 (test)
F1 Score86.19
24
Named Entity RecognitionCoNLL English 2003
F1 Score91.6
19
Showing 10 of 15 rows

Other info

Follow for update