Learning Attention-based Embeddings for Relation Prediction in Knowledge Graphs

06/04/2019
by   Deepak Nathani, et al.
0

The recent proliferation of knowledge graphs (KGs) coupled with incomplete or partial information, in the form of missing relations (links) between entities, has fueled a lot of research on knowledge base completion (also known as relation prediction). Several recent works suggest that convolutional neural network (CNN) based models generate richer and more expressive feature embeddings and hence also perform well on relation prediction. However, we observe that these KG embeddings treat triples independently and thus fail to cover the complex and hidden information that is inherently implicit in the local neighborhood surrounding a triple. To this effect, our paper proposes a novel attention based feature embedding that captures both entity and relation features in any given entity's neighborhood. Additionally, we also encapsulate relation clusters and multihop relations in our model. Our empirical study offers insights into the efficacy of our attention based model and we show marked performance gains in comparison to state of the art methods on all datasets.

READ FULL TEXT
research
06/07/2022

Learning Attention-based Representations from Multiple Patterns for Relation Prediction in Knowledge Graphs

Knowledge bases, and their representations in the form of knowledge grap...
research
11/04/2018

Logic Attention Based Neighborhood Aggregation for Inductive Knowledge Graph Embedding

Knowledge graph embedding aims at modeling entities and relations with l...
research
05/25/2019

MDE: Multi Distance Embeddings for Link Prediction in Knowledge Graphs

Over the past decade, knowledge graphs became popular for capturing stru...
research
09/16/2020

Type-augmented Relation Prediction in Knowledge Graphs

Knowledge graphs (KGs) are of great importance to many real world applic...
research
05/16/2016

A Critical Examination of RESCAL for Completion of Knowledge Bases with Transitive Relations

Link prediction in large knowledge graphs has received a lot of attentio...
research
08/25/2018

Data-dependent Learning of Symmetric/Antisymmetric Relations for Knowledge Base Completion

Embedding-based methods for knowledge base completion (KBC) learn repres...
research
12/08/2020

Joint Entity and Relation Canonicalization in Open Knowledge Graphs using Variational Autoencoders

Noun phrases and relation phrases in open knowledge graphs are not canon...

Please sign up or login with your details

Forgot password? Click here to reset