WCL-BBCD: A Contrastive Learning and Knowledge Graph Approach to Named Entity Recognition

03/14/2022
by   Renjie Zhou, et al.
12

Named Entity Recognition task is one of the core tasks of information extraction.Word ambiguity and word abbreviation are important reasons for the low recognition rate of named entities. In this paper, we propose a novel named entity recognition model WCL-BBCD (Word Contrastive Learning with BERT-BiLSTM-CRF-DBpedia) incorporating the idea of contrastive learning. The model first trains the sentence pairs in the text, calculate similarity between words in sentence pairs by cosine similarity, and fine-tunes the BERT model used for the named entity recognition task through the similarity, so as to alleviate word ambiguity. Then, the fine-tuned BERT model is combined with the BiLSTM-CRF model to perform the named entity recognition task. Finally, the recognition results are corrected in combination with prior knowledge such as knowledge graphs, so as to alleviate the recognition caused by word abbreviations low-rate problem. Experimental results show that our model outperforms other similar model methods on the CoNLL-2003 English dataset and OntoNotes V5 English dataset.

READ FULL TEXT
research
11/30/2021

Chemical Identification and Indexing in PubMed Articles via BERT and Text-to-Text Approaches

The Biocreative VII Track-2 challenge consists of named entity recogniti...
research
07/05/2023

Named Entity Inclusion in Abstractive Text Summarization

We address the named entity omission - the drawback of many current abst...
research
07/09/2018

Constructing a Word Similarity Graph from Vector based Word Representation for Named Entity Recognition

In this paper, we discuss a method for identifying a seed word that woul...
research
07/10/2020

Neural Knowledge Extraction From Cloud Service Incidents

In the last decade, two paradigm shifts have reshaped the software indus...
research
04/09/2020

Interpretability Analysis for Named Entity Recognition to Understand System Predictions and How They Can Improve

Named Entity Recognition systems achieve remarkable performance on domai...
research
03/21/2022

An Intellectual Property Entity Recognition Method Based on Transformer and Technological Word Information

Patent texts contain a large amount of entity information. Through named...
research
05/29/2017

Supervised Complementary Entity Recognition with Augmented Key-value Pairs of Knowledge

Extracting opinion targets is an important task in sentiment analysis on...

Please sign up or login with your details

Forgot password? Click here to reset