Learning Named Entity Tagger using Domain-Specific Dictionary

09/10/2018
by   Jingbo Shang, et al.
0

Recent advances in deep neural models allow us to build reliable named entity recognition (NER) systems without handcrafting features. However, such methods require large amounts of manually-labeled training data. There have been efforts on replacing human annotations with distant supervision (in conjunction with external dictionaries), but the generated noisy labels pose significant challenges on learning effective neural models. Here we propose two neural models to suit noisy distant supervision from the dictionary. First, under the traditional sequence labeling framework, we propose a revised fuzzy CRF layer to handle tokens with multiple possible labels. After identifying the nature of noisy labels in distant supervision, we go beyond the traditional framework and propose a novel, more effective neural model AutoNER with a new Tie or Break scheme. In addition, we discuss how to refine distant supervision for better NER performance. Extensive experiments on three benchmark datasets demonstrate that AutoNER achieves the best performance when only using dictionaries with no additional human effort, and delivers competitive results with state-of-the-art supervised benchmarks.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/28/2020

BOND: BERT-Assisted Open-Domain Named Entity Recognition with Distant Supervision

We study the open-domain named entity recognition (NER) problem under di...
research
12/03/2019

HAMNER: Headword Amplified Multi-span Distantly Supervised Method for Domain Specific Named Entity Recognition

To tackle Named Entity Recognition (NER) tasks, supervised methods need ...
research
04/17/2021

Learning from Noisy Labels for Entity-Centric Information Extraction

Recent efforts for information extraction have relied on many deep neura...
research
06/17/2021

De-biasing Distantly Supervised Named Entity Recognition via Causal Intervention

Distant supervision tackles the data bottleneck in NER by automatically ...
research
06/09/2020

Foreshadowing the Benefits of Incidental Supervision

Learning theory mostly addresses the standard learning paradigm, assumin...
research
08/31/2019

Named Entity Recognition Only from Word Embeddings

Deep neural network models have helped named entity (NE) recognition ach...
research
10/09/2021

Improving Distantly-Supervised Named Entity Recognition with Self-Collaborative Denoising Learning

Distantly supervised named entity recognition (DS-NER) efficiently reduc...

Please sign up or login with your details

Forgot password? Click here to reset