Chains of Reasoning over Entities, Relations, and Text using Recurrent Neural Networks

by   Rajarshi Das, et al.

Our goal is to combine the rich multistep inference of symbolic logical reasoning with the generalization capabilities of neural networks. We are particularly interested in complex reasoning about entities and relations in text and large-scale knowledge bases (KBs). Neelakantan et al. (2015) use RNNs to compose the distributed semantics of multi-hop paths in KBs; however for multiple reasons, the approach lacks accuracy and practicality. This paper proposes three significant modeling advances: (1) we learn to jointly reason about relations, entities, and entity-types; (2) we use neural attention modeling to incorporate multiple paths; (3) we learn to share strength in a single RNN that represents logical composition across all relations. On a largescale Freebase+ClueWeb prediction task, we achieve 25 and a 53 of reasoning in WordNet we reduce error in mean quantile by 84 state-of-the-art. The code and data are available at


page 1

page 2

page 3

page 4


Recurrent One-Hop Predictions for Reasoning over Knowledge Graphs

Large scale knowledge graphs (KGs) such as Freebase are generally incomp...

SIRE: Separate Intra- and Inter-sentential Reasoning for Document-level Relation Extraction

Document-level relation extraction has attracted much attention in recen...

Embedding Entities and Relations for Learning and Inference in Knowledge Bases

We consider learning representations of entities and relations in KBs us...

An Introduction to Logical Relations

Logical relations (LR) have been around for many years, and today they a...

Open Relation Modeling: Learning to Define Relations between Entities

Relations between entities can be represented by different instances, e....

Probabilistic Case-based Reasoning for Open-World Knowledge Graph Completion

A case-based reasoning (CBR) system solves a new problem by retrieving `...

SNeL: A Structured Neuro-Symbolic Language for Entity-Based Multimodal Scene Understanding

In the evolving landscape of artificial intelligence, multimodal and Neu...

Please sign up or login with your details

Forgot password? Click here to reset