Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Parallel Instance Query Network for Named Entity Recognition

About

Named entity recognition (NER) is a fundamental task in natural language processing. Recent works treat named entity recognition as a reading comprehension task, constructing type-specific queries manually to extract entities. This paradigm suffers from three issues. First, type-specific queries can only extract one type of entities per inference, which is inefficient. Second, the extraction for different types of entities is isolated, ignoring the dependencies between them. Third, query construction relies on external knowledge and is difficult to apply to realistic scenarios with hundreds of entity types. To deal with them, we propose Parallel Instance Query Network (PIQN), which sets up global and learnable instance queries to extract entities from a sentence in a parallel manner. Each instance query predicts one entity, and by feeding all instance queries simultaneously, we can query all entities in parallel. Instead of being constructed from external knowledge, instance queries can learn their different query semantics during training. For training the model, we treat label assignment as a one-to-many Linear Assignment Problem (LAP) and dynamically assign gold entities to instance queries with minimal assignment cost. Experiments on both nested and flat NER datasets demonstrate that our proposed method outperforms previous state-of-the-art models.

Yongliang Shen, Xiaobin Wang, Zeqi Tan, Guangwei Xu, Pengjun Xie, Fei Huang, Weiming Lu, Yueting Zhuang• 2022

Related benchmarks

TaskDatasetResultRank
Named Entity RecognitionCoNLL 2003 (test)
F1 Score92.87
539
Nested Named Entity RecognitionACE 2004 (test)
F1 Score88.14
166
Nested Named Entity RecognitionACE 2005 (test)
F1 Score87.42
153
Nested Named Entity RecognitionGENIA (test)
F1 Score81.77
140
Named Entity RecognitionACE04 (test)
F1 Score88.14
36
Named Entity RecognitionGENIA (test)--
34
Nested Named Entity RecognitionKBP English 2017 (test)
Precision85.67
28
Named Entity RecognitionCoNLL English 2003
F1 Score92.87
19
Named Entity RecognitionACE05 splits of Lu and Roth (test)
F1 Score87.42
14
Nested Named Entity RecognitionNNE (test)
Precision93.85
12
Showing 10 of 13 rows

Other info

Code

Follow for update