SpanProto: A Two-stage Span-based Prototypical Network for Few-shot Named Entity Recognition

10/17/2022
by   Jianing Wang, et al.
0

Few-shot Named Entity Recognition (NER) aims to identify named entities with very little annotated data. Previous methods solve this problem based on token-wise classification, which ignores the information of entity boundaries, and inevitably the performance is affected by the massive non-entity tokens. To this end, we propose a seminal span-based prototypical network (SpanProto) that tackles few-shot NER via a two-stage approach, including span extraction and mention classification. In the span extraction stage, we transform the sequential tags into a global boundary matrix, enabling the model to focus on the explicit boundary information. For mention classification, we leverage prototypical learning to capture the semantic representations for each labeled span and make the model better adapt to novel-class entities. To further improve the model performance, we split out the false positives generated by the span extractor but not labeled in the current episode set, and then present a margin-based loss to separate them from each prototype region. Experiments over multiple benchmarks demonstrate that our model outperforms strong baselines by a large margin.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/12/2022

Decomposed Meta-Learning for Few-Shot Named Entity Recognition

Few-shot named entity recognition (NER) systems aim at recognizing novel...
research
04/27/2022

Propose-and-Refine: A Two-Stage Set Prediction Network for Nested Named Entity Recognition

Nested named entity recognition (nested NER) is a fundamental task in na...
research
02/13/2023

Type-Aware Decomposed Framework for Few-Shot Named Entity Recognition

Despite the recent success achieved by several two-stage prototypical ne...
research
08/05/2022

Global Pointer: Novel Efficient Span-based Approach for Named Entity Recognition

Named entity recognition (NER) task aims at identifying entities from a ...
research
11/24/2022

Detecting Entities in the Astrophysics Literature: A Comparison of Word-based and Span-based Entity Recognition Methods

Information Extraction from scientific literature can be challenging due...
research
08/28/2023

A Multi-Task Semantic Decomposition Framework with Task-specific Pre-training for Few-Shot NER

The objective of few-shot named entity recognition is to identify named ...
research
06/09/2020

Extensive Error Analysis and a Learning-Based Evaluation of Medical Entity Recognition Systems to Approximate User Experience

When comparing entities extracted by a medical entity recognition system...

Please sign up or login with your details

Forgot password? Click here to reset