Recurrent Relational Networks for Complex Relational Reasoning

11/21/2017
by   Rasmus Berg Palm, et al.
0

Humans possess an ability to abstractly reason about objects and their interactions, an ability not shared with state-of-the-art deep learning models. Relational networks, introduced by Santoro et al. (2017), add the capacity for relational reasoning to deep neural networks, but are limited in the complexity of the reasoning tasks they can address. We introduce recurrent relational networks which increase the suite of solvable tasks to those that require an order of magnitude more steps of relational reasoning. We use recurrent relational networks to solve Sudoku puzzles and achieve state-of-the-art results by solving 96.6 networks fail to solve any. We also apply our model to the BaBi textual QA dataset solving 19/20 tasks which is competitive with state-of-the-art sparse differentiable neural computers. The recurrent relational network is a general purpose module that can augment any neural network model with the capacity to do many-step relational reasoning.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/05/2017

A simple neural network module for relational reasoning

Relational reasoning is a central component of generally intelligent beh...
research
11/05/2018

Multi-layer Relation Networks

Relational Networks (RN) as introduced by Santoro et al. (2017) have dem...
research
06/05/2018

Relational recurrent neural networks

Memory-based neural networks model temporal data by leveraging an abilit...
research
04/19/2022

GroupNet: Multiscale Hypergraph Neural Networks for Trajectory Prediction with Relational Reasoning

Demystifying the interactions among multiple agents from their past traj...
research
05/12/2019

The relational processing limits of classic and contemporary neural network models of language processing

The ability of neural networks to capture relational knowledge is a matt...
research
11/22/2017

Temporal Relational Reasoning in Videos

Temporal relational reasoning, the ability to link meaningful transforma...
research
03/25/2020

Solving Raven's Progressive Matrices with Multi-Layer Relation Networks

Raven's Progressive Matrices are a benchmark originally designed to test...

Please sign up or login with your details

Forgot password? Click here to reset