DeepAI AI Chat
Log In Sign Up

Dynamic Transfer Learning for Named Entity Recognition

by   Parminder Bhatia, et al.
University of Central Florida

State-of-the-art named entity recognition (NER) systems have been improving continuously using neural architectures over the past several years. However, many tasks including NER require large sets of annotated data to achieve such performance. In particular, we focus on NER from clinical notes, which is one of the most fundamental and critical problems for medical text analysis. Our work centers on effectively adapting these neural architectures towards low-resource settings using parameter transfer methods. We complement a standard hierarchical NER model with a general transfer learning framework consisting of parameter sharing between the source and target tasks, and showcase scores significantly above the baseline architecture. These sharing schemes require an exponential search over tied parameter sets to generate an optimal configuration. To mitigate the problem of exhaustively searching for model optimization, we propose the Dynamic Transfer Networks (DTN), a gated architecture which learns the appropriate parameter sharing scheme between source and target datasets. DTN achieves the improvements of the optimized transfer learning framework with just a single training setting, effectively removing the need for exponential search.


page 1

page 2

page 3

page 4


Label-aware Double Transfer Learning for Cross-Specialty Medical Named Entity Recognition

We study the problem of named entity recognition (NER) from electronic m...

Transfer Learning for Named-Entity Recognition with Neural Networks

Recent approaches based on artificial neural networks (ANNs) have shown ...

Zero-Resource Cross-Lingual Named Entity Recognition

Recently, neural methods have achieved state-of-the-art (SOTA) results i...

A Multi-task Learning Approach for Named Entity Recognition using Local Detection

Named entity recognition (NER) systems that perform well require task-re...

An Open-Source Dataset and A Multi-Task Model for Malay Named Entity Recognition

Named entity recognition (NER) is a fundamental task of natural language...

End-to-end Joint Entity Extraction and Negation Detection for Clinical Text

Negative medical findings are prevalent in clinical reports, yet discrim...

CliNER 2.0: Accessible and Accurate Clinical Concept Extraction

Clinical notes often describe important aspects of a patient's stay and ...