A Prototypical Semantic Decoupling Method via Joint Contrastive Learning for Few-Shot Name Entity Recognition

02/27/2023
by   Guanting Dong, et al.
0

Few-shot named entity recognition (NER) aims at identifying named entities based on only few labeled instances. Most existing prototype-based sequence labeling models tend to memorize entity mentions which would be easily confused by close prototypes. In this paper, we proposed a Prototypical Semantic Decoupling method via joint Contrastive learning (PSDC) for few-shot NER. Specifically, we decouple class-specific prototypes and contextual semantic prototypes by two masking strategies to lead the model to focus on two different semantic information for inference. Besides, we further introduce joint contrastive learning objectives to better integrate two kinds of decoupling information and prevent semantic collapse. Experimental results on two few-shot NER benchmarks demonstrate that PSDC consistently outperforms the previous SOTA methods in terms of overall performance. Extensive analysis further validates the effectiveness and generalization of PSDC.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
08/28/2023

A Multi-Task Semantic Decomposition Framework with Task-specific Pre-training for Few-Shot NER

The objective of few-shot named entity recognition is to identify named ...
research
08/17/2022

Few-shot Named Entity Recognition with Entity-level Prototypical Network Enhanced by Dispersedly Distributed Prototypes

Few-shot named entity recognition (NER) enables us to build a NER system...
research
05/29/2023

ContrastNER: Contrastive-based Prompt Tuning for Few-shot NER

Prompt-based language models have produced encouraging results in numero...
research
12/02/2022

Few-Shot Nested Named Entity Recognition

While Named Entity Recognition (NER) is a widely studied task, making in...
research
10/11/2022

SEE-Few: Seed, Expand and Entail for Few-shot Named Entity Recognition

Few-shot named entity recognition (NER) aims at identifying named entiti...
research
10/29/2020

Improving Named Entity Recognition with Attentive Ensemble of Syntactic Information

Named entity recognition (NER) is highly sensitive to sentential syntact...
research
04/09/2022

MINER: Improving Out-of-Vocabulary Named Entity Recognition from an Information Theoretic Perspective

NER model has achieved promising performance on standard NER benchmarks....

Please sign up or login with your details

Forgot password? Click here to reset