Few-shot Learning for Named Entity Recognition in Medical Text

11/13/2018
by   Maximilian Hofer, et al.
0

Deep neural network models have recently achieved state-of-the-art performance gains in a variety of natural language processing (NLP) tasks (Young, Hazarika, Poria, & Cambria, 2017). However, these gains rely on the availability of large amounts of annotated examples, without which state-of-the-art performance is rarely achievable. This is especially inconvenient for the many NLP fields where annotated examples are scarce, such as medical text. To improve NLP models in this situation, we evaluate five improvements on named entity recognition (NER) tasks when only ten annotated examples are available: (1) layer-wise initialization with pre-trained weights, (2) hyperparameter tuning, (3) combining pre-training data, (4) custom word embeddings, and (5) optimizing out-of-vocabulary (OOV) words. Experimental results show that the F1 score of 69.3 can be improved to 78.87

READ FULL TEXT
research
02/09/2020

Application of Pre-training Models in Named Entity Recognition

Named Entity Recognition (NER) is a fundamental Natural Language Process...
research
01/06/2019

Named Entity Recognition in Electronic Health Records Using Transfer Learning Bootstrapped Neural Networks

Neural networks (NNs) have become the state of the art in many machine l...
research
03/29/2019

CUTIE: Learning to Understand Documents with Convolutional Universal Text Information Extractor

Extracting key information from documents, such as receipts or invoices,...
research
10/23/2019

NER Models Using Pre-training and Transfer Learning for Healthcare

In this paper, we present our approach to extract structured information...
research
08/31/2019

Named Entity Recognition Only from Word Embeddings

Deep neural network models have helped named entity (NE) recognition ach...
research
03/08/2022

A Unified Framework of Medical Information Annotation and Extraction for Chinese Clinical Text

Medical information extraction consists of a group of natural language p...
research
08/24/2017

Combining Discrete and Neural Features for Sequence Labeling

Neural network models have recently received heated research attention i...

Please sign up or login with your details

Forgot password? Click here to reset