Improving Named Entity Recognition by External Context Retrieving and Cooperative Learning

05/08/2021
by   Xinyu Wang, et al.
12

Recent advances in Named Entity Recognition (NER) show that document-level contexts can significantly improve model performance. In many application scenarios, however, such contexts are not available. In this paper, we propose to find external contexts of a sentence by retrieving and selecting a set of semantically relevant texts through a search engine, with the original sentence as the query. We find empirically that the contextual representations computed on the retrieval-based input view, constructed through the concatenation of a sentence and its external contexts, can achieve significantly improved performance compared to the original input view based only on the sentence. Furthermore, we can improve the model performance of both input views by Cooperative Learning, a training method that encourages the two input views to produce similar contextual representations or output label distributions. Experiments show that our approach can achieve new state-of-the-art performance on 8 NER data sets across 5 domains.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/23/2022

Improving Chinese Named Entity Recognition by Search Engine Augmentation

Compared with English, Chinese suffers from more grammatical ambiguities...
research
11/06/2019

Hierarchical Contextualized Representation for Named Entity Recognition

Current named entity recognition (NER) models are typically based on the...
research
03/01/2022

DAMO-NLP at SemEval-2022 Task 11: A Knowledge-based System for Multilingual Named Entity Recognition

The MultiCoNER shared task aims at detecting semantically ambiguous and ...
research
06/28/2023

Sentence-to-Label Generation Framework for Multi-task Learning of Japanese Sentence Classification and Named Entity Recognition

Information extraction(IE) is a crucial subfield within natural language...
research
06/02/2021

Exploiting Global Contextual Information for Document-level Named Entity Recognition

Most existing named entity recognition (NER) approaches are based on seq...
research
04/05/2019

Effective Context and Fragment Feature Usage for Named Entity Recognition

In this paper, we explore a new approach to named entity recognition (NE...
research
12/11/2020

An End-to-End Solution for Named Entity Recognition in eCommerce Search

Named entity recognition (NER) is a critical step in modern search query...

Please sign up or login with your details

Forgot password? Click here to reset