Prompt-Based Metric Learning for Few-Shot NER

11/08/2022
by   Yanru Chen, et al.
0

Few-shot named entity recognition (NER) targets generalizing to unseen labels and/or domains with few labeled examples. Existing metric learning methods compute token-level similarities between query and support sets, but are not able to fully incorporate label semantics into modeling. To address this issue, we propose a simple method to largely improve metric learning for NER: 1) multiple prompt schemas are designed to enhance label semantics; 2) we propose a novel architecture to effectively combine multiple prompt-based representations. Empirically, our method achieves new state-of-the-art (SOTA) results under 16 of the 18 considered settings, substantially outperforming the previous SOTA by an average of 8.84 of micro F1. Our code is available at https://github.com/AChen-qaq/ProML.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/29/2021

Learning from Miscellaneous Other-Class Words for Few-shot Named Entity Recognition

Few-shot Named Entity Recognition (NER) exploits only a handful of annot...
research
08/24/2022

FactMix: Using a Few Labeled In-domain Examples to Generalize to Cross-domain Named Entity Recognition

Few-shot Named Entity Recognition (NER) is imperative for entity tagging...
research
05/24/2023

PromptNER: Prompting For Named Entity Recognition

In a surprising turn, Large Language Models (LLMs) together with a growi...
research
10/11/2022

SEE-Few: Seed, Expand and Entail for Few-shot Named Entity Recognition

Few-shot named entity recognition (NER) aims at identifying named entiti...
research
10/24/2022

Enhancing Label Consistency on Document-level Named Entity Recognition

Named entity recognition (NER) is a fundamental part of extracting infor...
research
03/31/2022

kNN-NER: Named Entity Recognition with Nearest Neighbor Search

Inspired by recent advances in retrieval augmented methods in NLP <cit.>...
research
05/09/2020

The Structured Weighted Violations MIRA

We present the Structured Weighted Violation MIRA (SWVM), a new structur...

Please sign up or login with your details

Forgot password? Click here to reset