InstructionNER: A Multi-Task Instruction-Based Generative Framework for Few-shot NER

03/08/2022
by   Liwen Wang, et al.
0

Recently, prompt-based methods have achieved significant performance in few-shot learning scenarios by bridging the gap between language model pre-training and fine-tuning for downstream tasks. However, existing prompt templates are mostly designed for sentence-level tasks and are inappropriate for sequence labeling objectives. To address the above issue, we propose a multi-task instruction-based generative framework, named InstructionNER, for low-resource named entity recognition. Specifically, we reformulate the NER task as a generation problem, which enriches source sentences with task-specific instructions and answer options, then inferences the entities and types in natural language. We further propose two auxiliary tasks, including entity extraction and entity typing, which enable the model to capture more boundary information of entities and deepen the understanding of entity type semantics, respectively. Experimental results show that our method consistently outperforms other baselines on five datasets in few-shot settings.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
08/28/2023

A Multi-Task Semantic Decomposition Framework with Task-specific Pre-training for Few-Shot NER

The objective of few-shot named entity recognition is to identify named ...
research
05/18/2023

Learning In-context Learning for Named Entity Recognition

Named entity recognition in real-world applications suffers from the div...
research
09/28/2021

Template-free Prompt Tuning for Few-shot NER

Prompt-based methods have been successfully applied in sentence-level fe...
research
05/26/2023

PromptNER: Prompt Locating and Typing for Named Entity Recognition

Prompt learning is a new paradigm for utilizing pre-trained language mod...
research
09/03/2021

An Open-Source Dataset and A Multi-Task Model for Malay Named Entity Recognition

Named entity recognition (NER) is a fundamental task of natural language...
research
04/20/2023

GPT-NER: Named Entity Recognition via Large Language Models

Despite the fact that large-scale Language Models (LLM) have achieved SO...
research
09/15/2020

Augmented Natural Language for Generative Sequence Labeling

We propose a generative framework for joint sequence labeling and senten...

Please sign up or login with your details

Forgot password? Click here to reset