Embedding Entities and Relations for Learning and Inference in Knowledge Bases

12/20/2014
by   Bishan Yang, et al.
0

We consider learning representations of entities and relations in KBs using the neural-embedding approach. We show that most existing models, including NTN (Socher et al., 2013) and TransE (Bordes et al., 2013b), can be generalized under a unified learning framework, where entities are low-dimensional vectors learned from a neural network and relations are bilinear and/or linear mapping functions. Under this framework, we compare a variety of embedding models on the link prediction task. We show that a simple bilinear formulation achieves new state-of-the-art results for the task (achieving a top-10 accuracy of 73.2 vs. 54.7 that utilizes the learned relation embeddings to mine logical rules such as "BornInCity(a,b) and CityInCountry(b,c) => Nationality(a,c)". We find that embeddings learned from the bilinear objective are particularly good at capturing relational semantics and that the composition of relations is characterized by matrix multiplication. More interestingly, we demonstrate that our embedding-based rule extraction approach successfully outperforms a state-of-the-art confidence-based rule mining approach in mining Horn rules that involve compositional reasoning.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/24/2022

RulE: Neural-Symbolic Knowledge Graph Reasoning with Rule Embedding

Knowledge graph (KG) reasoning is an important problem for knowledge gra...
research
12/18/2021

DegreEmbed: incorporating entity embedding into logic rule learning for knowledge graph reasoning

Knowledge graphs (KGs), as structured representations of real world fact...
research
11/14/2014

Learning Multi-Relational Semantics Using Neural-Embedding Models

In this paper we present a unified framework for modeling multi-relation...
research
07/05/2016

Chains of Reasoning over Entities, Relations, and Text using Recurrent Neural Networks

Our goal is to combine the rich multistep inference of symbolic logical ...
research
10/19/2021

What is Learned in Knowledge Graph Embeddings?

A knowledge graph (KG) is a data structure which represents entities and...
research
10/23/2019

A Unifying Framework of Bilinear LSTMs

This paper presents a novel unifying framework of bilinear LSTMs that ca...
research
06/22/2019

Learning Set-equivariant Functions with SWARM Mappings

In this work we propose a new neural network architecture that efficient...

Please sign up or login with your details

Forgot password? Click here to reset