Does constituency analysis enhance domain-specific pre-trained BERT models for relation extraction?

11/25/2021
by   Anfu Tang, et al.
0

Recently many studies have been conducted on the topic of relation extraction. The DrugProt track at BioCreative VII provides a manually-annotated corpus for the purpose of the development and evaluation of relation extraction systems, in which interactions between chemicals and genes are studied. We describe the ensemble system that we used for our submission, which combines predictions of fine-tuned bioBERT, sciBERT and const-bioBERT models by majority voting. We specifically tested the contribution of syntactic information to relation extraction with BERT. We observed that adding constituentbased syntactic information to BERT improved precision, but decreased recall, since relations rarely seen in the train set were less likely to be predicted by BERT models in which the syntactic information is infused. Our code is available online [https://github.com/Maple177/drugprot-relation-extraction].

READ FULL TEXT
research
12/18/2020

An Empirical Study of Using Pre-trained BERT Models for Vietnamese Relation Extraction Task at VLSP 2020

In this paper, we present an empirical study of using pre-trained BERT m...
research
12/11/2018

RESIDE: Improving Distantly-Supervised Neural Relation Extraction using Side Information

Distantly-supervised Relation Extraction (RE) methods train an extractor...
research
04/10/2019

Simple BERT Models for Relation Extraction and Semantic Role Labeling

We present simple BERT-based models for relation extraction and semantic...
research
03/25/2019

Connecting Language and Knowledge with Heterogeneous Representations for Neural Relation Extraction

Knowledge Bases (KBs) require constant up-dating to reflect changes to t...
research
10/26/2020

Relation Extraction for Monitoring Economic Networks

Relation extraction from texts is a research topic since the message und...
research
09/14/2020

Can Fine-tuning Pre-trained Models Lead to Perfect NLP? A Study of the Generalizability of Relation Extraction

Fine-tuning pre-trained models have achieved impressive performance on s...
research
11/24/2020

Experiments on transfer learning architectures for biomedical relation extraction

Relation extraction (RE) consists in identifying and structuring automat...

Please sign up or login with your details

Forgot password? Click here to reset