Back Attention Knowledge Transfer for Low-resource Named Entity Recognition

06/04/2019
by   Linghao Sun, et al.
0

In recent years, great success has been achieved in the field of natural language processing (NLP), thanks in part to the considerable amount of annotated resources. For named entity recognition (NER), most languages do not have such an abundance of labeled data, so the performances of those languages are comparatively lower. To improve the performance, we propose a general approach called Back Attention Network (BAN). BAN uses translation system to translate other language sentences into English and utilizes the pre-trained English NER model to get task-specific information. After that, BAN applies a new mechanism named back attention knowledge transfer to improve the semantic representation, which aids in generation of the result. Experiments on three different language datasets indicate that our approach outperforms other state-of-the-art methods.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
12/19/2022

MANER: Mask Augmented Named Entity Recognition for Extreme Low-Resource Languages

This paper investigates the problem of Named Entity Recognition (NER) fo...
research
09/03/2021

An Open-Source Dataset and A Multi-Task Model for Malay Named Entity Recognition

Named entity recognition (NER) is a fundamental task of natural language...
research
03/06/2020

Improving Neural Named Entity Recognition with Gazetteers

The goal of this work is to improve the performance of a neural named en...
research
03/28/2022

Using Domain Knowledge for Low Resource Named Entity Recognition

In recent years, named entity recognition has always been a popular rese...
research
07/02/2020

NLNDE: Enhancing Neural Sequence Taggers with Attention and Noisy Channel for Robust Pharmacological Entity Detection

Named entity recognition has been extensively studied on English news te...
research
04/10/2021

Not All Attention Is All You Need

Self-attention based models have achieved remarkable success in natural ...
research
07/12/2021

DaCy: A Unified Framework for Danish NLP

Danish natural language processing (NLP) has in recent years obtained co...

Please sign up or login with your details

Forgot password? Click here to reset