DeepAI AI Chat
Log In Sign Up

Text Mining Drug/Chemical-Protein Interactions using an Ensemble of BERT and T5 Based Models

by   Virginia Adams, et al.

In Track-1 of the BioCreative VII Challenge participants are asked to identify interactions between drugs/chemicals and proteins. In-context named entity annotations for each drug/chemical and protein are provided and one of fourteen different interactions must be automatically predicted. For this relation extraction task, we attempt both a BERT-based sentence classification approach, and a more novel text-to-text approach using a T5 model. We find that larger BERT-based models perform better in general, with our BioMegatron-based model achieving the highest scores across all metrics, achieving 0.74 F1 score. Though our novel T5 text-to-text method did not perform as well as most of our BERT-based models, it outperformed those trained on similar data, showing promising results, achieving 0.65 F1 score. We believe a text-to-text approach to relation extraction has some competitive advantages and there is a lot of room for research advancement.


page 1

page 2

page 3

page 4


An Empirical Study of Using Pre-trained BERT Models for Vietnamese Relation Extraction Task at VLSP 2020

In this paper, we present an empirical study of using pre-trained BERT m...

BioRED: A Comprehensive Biomedical Relation Extraction Dataset

Automated relation extraction (RE) from biomedical literature is critica...

Chemical-protein relation extraction with ensembles of SVM, CNN, and RNN models

Text mining the relations between chemicals and proteins is an increasin...

BERT-Based Multi-Head Selection for Joint Entity-Relation Extraction

In this paper, we report our method for the Information Extraction task ...

FoodChem: A food-chemical relation extraction model

In this paper, we present FoodChem, a new Relation Extraction (RE) model...

Machine learning modeling of family wide enzyme-substrate specificity screens

Biocatalysis is a promising approach to sustainably synthesize pharmaceu...

Towards Automated Anamnesis Summarization: BERT-based Models for Symptom Extraction

Professionals in modern healthcare systems are increasingly burdened by ...