SEPT: Improving Scientific Named Entity Recognition with Span Representation

11/08/2019
by   Tan Yan, et al.
0

We introduce a new scientific named entity recognizer called SEPT, which stands for Span Extractor with Pre-trained Transformers. In recent papers, span extractors have been demonstrated to be a powerful model compared with sequence labeling models. However, we discover that with the development of pre-trained language models, the performance of span extractors appears to become similar to sequence labeling models. To keep the advantages of span representation, we modified the model by under-sampling to balance the positive and negative samples and reduce the search space. Furthermore, we simplify the origin network architecture to combine the span extractor with BERT. Experiments demonstrate that even simplified architecture achieves the same performance and SEPT achieves a new state of the art result in scientific named entity recognition even without relation information involved.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
12/14/2022

VTCC-NLP at NL4Opt competition subtask 1: An Ensemble Pre-trained language models for Named Entity Recognition

We propose a combined three pre-trained language models (XLM-R, BART, an...
research
10/16/2020

Coarse-to-Fine Pre-training for Named Entity Recognition

More recently, Named Entity Recognition hasachieved great advances aided...
research
06/01/2021

SpanNER: Named Entity Re-/Recognition as Span Prediction

Recent years have seen the paradigm shift of Named Entity Recognition (N...
research
04/29/2020

Instance-Based Learning of Span Representations: A Case Study through Named Entity Recognition

Interpretable rationales for model predictions play a critical role in p...
research
09/13/2021

Pack Together: Entity and Relation Extraction with Levitated Marker

Named Entity Recognition (NER) and Relation Extraction (RE) are the core...
research
06/29/2023

Integrating Large Pre-trained Models into Multimodal Named Entity Recognition with Evidential Fusion

Multimodal Named Entity Recognition (MNER) is a crucial task for informa...
research
06/11/2021

EPICURE Ensemble Pretrained Models for Extracting Cancer Mutations from Literature

To interpret the genetic profile present in a patient sample, it is nece...

Please sign up or login with your details

Forgot password? Click here to reset