Fast and scalable learning of neuro-symbolic representations of biomedical knowledge

by   Asan Agibetov, et al.
MedUni Wien

In this work we address the problem of fast and scalable learning of neuro-symbolic representations for general biological knowledge. Based on a recently published comprehensive biological knowledge graph (Alshahrani, 2017) that was used for demonstrating neuro-symbolic representation learning, we show how to train fast (under 1 minute) log-linear neural embeddings of the entities. We utilize these representations as inputs for machine learning classifiers to enable important tasks such as biological link prediction. Classifiers are trained by concatenating learned entity embeddings to represent entity relations, and training classifiers on the concatenated embeddings to discern true relations from automatically generated negative examples. Our simple embedding methodology greatly improves on classification error compared to previously published state-of-the-art results, yielding a maximum increase of +0.28 F-measure and +0.22 ROC AUC scores for the most difficult biological link prediction problem. Finally, our embedding approach is orders of magnitude faster to train (≤ 1 minute vs. hours), much more economical in terms of embedding dimensions (d=50 vs. d=512), and naturally encodes the directionality of the asymmetric biological relations, that can be controlled by the order with which we concatenate the embeddings.


page 1

page 2

page 3

page 4


Node Co-occurrence based Graph Neural Networks for Knowledge Graph Link Prediction

We introduce a novel embedding model, named NoKE, which aims to integrat...

Interaction Embeddings for Prediction and Explanation in Knowledge Graphs

Knowledge graph embedding aims to learn distributed representations for ...

Learning to Borrow – Relation Representation for Without-Mention Entity-Pairs for Knowledge Graph Completion

Prior work on integrating text corpora with knowledge graphs (KGs) to im...

CoKE: Contextualized Knowledge Graph Embedding

Knowledge graph embedding, which projects symbolic entities and relation...

Drug Similarity and Link Prediction Using Graph Embeddings on Medical Knowledge Graphs

The paper utilizes the graph embeddings generated for entities of a larg...

Complex Embeddings for Simple Link Prediction

In statistical relational learning, the link prediction problem is key t...

Semantic Triple Encoder for Fast Open-Set Link Prediction

We improve both the open-set generalization and efficiency of link predi...

Please sign up or login with your details

Forgot password? Click here to reset