Towards Robust Named Entity Recognition for Historic German

06/18/2019
by   Stefan Schweter, et al.
0

Recent advances in language modeling using deep neural networks have shown that these models learn representations, that vary with the network depth from morphology to semantic relationships like co-reference. We apply pre-trained language models to low-resource named entity recognition for Historic German. We show on a series of experiments that character-based pre-trained language models do not run into trouble when faced with low-resource datasets. Our pre-trained character-based language models improve upon classical CRF-based methods and previous work on Bi-LSTMs by boosting F1 score performance by up to 6 https://github.com/stefan-it/historic-ner .

READ FULL TEXT

page 1

page 2

page 3

page 4

page 5

page 6

page 7

research
12/14/2022

VTCC-NLP at NL4Opt competition subtask 1: An Ensemble Pre-trained language models for Named Entity Recognition

We propose a combined three pre-trained language models (XLM-R, BART, an...
research
11/07/2018

microNER: A Micro-Service for German Named Entity Recognition based on BiLSTM-CRF

For named entity recognition (NER), bidirectional recurrent neural netwo...
research
05/29/2022

SFE-AI at SemEval-2022 Task 11: Low-Resource Named Entity Recognition using Large Pre-trained Language Models

Large scale pre-training models have been widely used in named entity re...
research
10/14/2019

Training Compact Models for Low Resource Entity Tagging using Pre-trained Language Models

Training models on low-resource named entity recognition tasks has been ...
research
06/27/2023

Using Large Language Models to Provide Explanatory Feedback to Human Tutors

Research demonstrates learners engaging in the process of producing expl...
research
11/06/2022

Prompt-based Text Entailment for Low-Resource Named Entity Recognition

Pre-trained Language Models (PLMs) have been applied in NLP tasks and ac...
research
09/13/2017

Empower Sequence Labeling with Task-Aware Neural Language Model

Linguistic sequence labeling is a general modeling approach that encompa...

Please sign up or login with your details

Forgot password? Click here to reset