Log In Sign Up

Learning A Unified Named Entity Tagger From Multiple Partially Annotated Corpora For Efficient Adaptation

by   Xiao Huang, et al.

Named entity recognition (NER) identifies typed entity mentions in raw text. While the task is well-established, there is no universally used tagset: often, datasets are annotated for use in downstream applications and accordingly only cover a small set of entity types relevant to a particular task. For instance, in the biomedical domain, one corpus might annotate genes, another chemicals, and another diseases---despite the texts in each corpus containing references to all three types of entities. In this paper, we propose a deep structured model to integrate these "partially annotated" datasets to jointly identify all entity types appearing in the training corpora. By leveraging multiple datasets, the model can learn robust input representations; by building a joint structured model, it avoids potential conflicts caused by combining several models' predictions at test time. Experiments show that the proposed model significantly outperforms strong multi-task learning baselines when training on multiple, partially annotated datasets and testing on datasets that contain tags from more than one of the training corpora.


page 1

page 2

page 3

page 4


Named Entity Recognition for Partially Annotated Datasets

The most common Named Entity Recognizers are usually sequence taggers tr...

Analyzing the Effect of Multi-task Learning for Biomedical Named Entity Recognition

Developing high-performing systems for detecting biomedical named entiti...

CollaboNet: collaboration of deep neural networks for biomedical named entity recognition

Background: Finding biomedical named entities is one of the most essenti...

Partially-Typed NER Datasets Integration: Connecting Practice to Theory

While typical named entity recognition (NER) models require the training...

Biomedical Mention Disambiguation using a Deep Learning Approach

Automatically locating named entities in natural language text - named e...

Information Extraction based on Named Entity for Tourism Corpus

Tourism information is scattered around nowadays. To search for the info...

Uncovering the Corona Virus Map Using Deep Entities and Relationship Models

We extract entities and relationships related to COVID-19 from a corpus ...