Exploring Semi-supervised Variational Autoencoders for Biomedical Relation Extraction

01/18/2019
by   Yijia Zhang, et al.
0

The biomedical literature provides a rich source of knowledge such as protein-protein interactions (PPIs), drug-drug interactions (DDIs) and chemical-protein interactions (CPIs). Biomedical relation extraction aims to automatically extract biomedical relations from biomedical text for various biomedical research. State-of-the-art methods for biomedical relation extraction are primarily based on supervised machine learning and therefore depend on (sufficient) labeled data. However, creating large sets of training data is prohibitively expensive and labor-intensive, especially so in biomedicine as domain knowledge is required. In contrast, there is a large amount of unlabeled biomedical text available in PubMed. Hence, computational methods capable of employing unlabeled data to reduce the burden of manual annotation are of particular interest in biomedical relation extraction. We present a novel semi-supervised approach based on variational autoencoder (VAE) for biomedical relation extraction. Our model consists of the following three parts, a classifier, an encoder and a decoder. The classifier is implemented using multi-layer convolutional neural networks (CNNs), and the encoder and decoder are implemented using both bidirectional long short-term memory networks (Bi-LSTMs) and CNNs, respectively. The semi-supervised mechanism allows our model to learn features from both the labeled and unlabeled data. We evaluate our method on multiple public PPI, DDI and CPI corpora. Experimental results show that our method effectively exploits the unlabeled data to improve the performance and reduce the dependence on labeled data. To our best knowledge, this is the first semi-supervised VAE-based method for (biomedical) relation extraction. Our results suggest that exploiting such unlabeled data can be greatly beneficial to improved performance in various biomedical relation extraction.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/08/2020

Adversarial Learning for Supervised and Semi-supervised Relation Extraction in Biomedical Literature

Adversarial training is a technique of improving model performance by in...
research
06/19/2023

BioREx: Improving Biomedical Relation Extraction by Leveraging Heterogeneous Datasets

Biomedical relation extraction (RE) is the task of automatically identif...
research
03/12/2021

A Review on Semi-Supervised Relation Extraction

Relation extraction (RE) plays an important role in extracting knowledge...
research
12/02/2021

From Consensus to Disagreement: Multi-Teacher Distillation for Semi-Supervised Relation Extraction

Lack of labeled data is a main obstacle in relation extraction. Semi-sup...
research
10/22/2020

Exploit Multiple Reference Graphs for Semi-supervised Relation Extraction

Manual annotation of the labeled data for relation extraction is time-co...
research
02/05/2018

Chemical-protein relation extraction with ensembles of SVM, CNN, and RNN models

Text mining the relations between chemicals and proteins is an increasin...
research
09/15/2021

A Relation-Oriented Clustering Method for Open Relation Extraction

The clustering-based unsupervised relation discovery method has graduall...

Please sign up or login with your details

Forgot password? Click here to reset