Neural-Symbolic Relational Reasoning on Graph Models: Effective Link Inference and Computation from Knowledge Bases

by   Henrique Lemos, et al.

The recent developments and growing interest in neural-symbolic models has shown that hybrid approaches can offer richer models for Artificial Intelligence. The integration of effective relational learning and reasoning methods is one of the key challenges in this direction, as neural learning and symbolic reasoning offer complementary characteristics that can benefit the development of AI systems. Relational labelling or link prediction on knowledge graphs has become one of the main problems in deep learning-based natural language processing research. Moreover, other fields which make use of neural-symbolic techniques may also benefit from such research endeavours. There have been several efforts towards the identification of missing facts from existing ones in knowledge graphs. Two lines of research try and predict knowledge relations between two entities by considering all known facts connecting them or several paths of facts connecting them. We propose a neural-symbolic graph neural network which applies learning over all the paths by feeding the model with the embedding of the minimal subset of the knowledge graph containing such paths. By learning to produce representations for entities and facts corresponding to word embeddings, we show how the model can be trained end-to-end to decode these representations and infer relations between entities in a multitask approach. Our contribution is two-fold: a neural-symbolic methodology leverages the resolution of relational inference in large graphs, and we also demonstrate that such neural-symbolic model is shown more effective than path-based approaches



There are no comments yet.


page 1

page 2

page 3

page 4


Knowledge Hypergraphs: Extending Knowledge Graphs Beyond Binary Relations

Knowledge graphs store facts using relations between pairs of entities. ...

Effective Integration of Symbolic and Connectionist Approaches through a Hybrid Representation

In this paper, we present our position for a neuralsymbolic integration ...

A Joint Framework for Inductive Representation Learning and Explainable Reasoning in Knowledge Graphs

Despite their large-scale coverage, existing cross-domain knowledge grap...

Neural Graph Embedding methods for Natural Language Processing

Knowledge graphs are structured representations of facts in a graph, whe...

Knowledge Graph Reasoning with Relational Directed Graph

Reasoning on the knowledge graph (KG) aims to infer new facts from exist...

Differentiable Reasoning on Large Knowledge Bases and Natural Language

Reasoning with knowledge expressed in natural language and Knowledge Bas...

On embeddings as an alternative paradigm for relational learning

Many real-world domains can be expressed as graphs and, more generally, ...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.