Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

PromptNER: Prompt Locating and Typing for Named Entity Recognition

About

Prompt learning is a new paradigm for utilizing pre-trained language models and has achieved great success in many tasks. To adopt prompt learning in the NER task, two kinds of methods have been explored from a pair of symmetric perspectives, populating the template by enumerating spans to predict their entity types or constructing type-specific prompts to locate entities. However, these methods not only require a multi-round prompting manner with a high time overhead and computational cost, but also require elaborate prompt templates, that are difficult to apply in practical scenarios. In this paper, we unify entity locating and entity typing into prompt learning, and design a dual-slot multi-prompt template with the position slot and type slot to prompt locating and typing respectively. Multiple prompts can be input to the model simultaneously, and then the model extracts all entities by parallel predictions on the slots. To assign labels for the slots during training, we design a dynamic template filling mechanism that uses the extended bipartite graph matching between prompts and the ground-truth entities. We conduct experiments in various settings, including resource-rich flat and nested NER datasets and low-resource in-domain and cross-domain datasets. Experimental results show that the proposed model achieves a significant performance improvement, especially in the cross-domain few-shot setting, which outperforms the state-of-the-art model by +7.7% on average.

Yongliang Shen, Zeqi Tan, Shuhui Wu, Wenqi Zhang, Rongsheng Zhang, Yadong Xi, Weiming Lu, Yueting Zhuang• 2023

Related benchmarks

TaskDatasetResultRank
Named Entity RecognitionCoNLL 2003 (test)
F1 Score93.08
539
Named Entity RecognitionMIT Restaurant
Micro-F177.4
50
Named Entity RecognitionACE04 (test)
F1 Score88.72
36
Named Entity RecognitionMIT Movie (target)
F1 Score84.5
36
Named Entity RecognitionCrossNER--
35
Named Entity RecognitionATIS target
F1 Score95.5
18
Named Entity RecognitionACE05 splits of Lu and Roth (test)
F1 Score88.26
14
Named Entity RecognitionCoNLL downsampled 2003 (test)
F1 (ORG)76.96
3
Showing 8 of 8 rows

Other info

Code

Follow for update