Relational dynamic memory networks

08/10/2018
by   Trang Pham, et al.
0

Working memory is an essential component of reasoning -- the capacity to answer a new question by manipulating acquired knowledge. Current memory-augmented neural networks offer a differentiable method to realize limited reasoning with support of a working memory module. Memory modules are often implemented as a set of memory slots without explicit relational exchange of content. This does not naturally match multi-relational domains in which data is structured. We design a new model dubbed Relational Dynamic Memory Network (RDMN) to fill this gap. The memory can have a single or multiple components, each of which realizes a multi-relational graph of memory slots. The memory is dynamically updated in the reasoning process controlled by the central controller. We evaluate the capability of RDMN on several important application domains: software vulnerability, molecular bioactivity and chemical reaction. Results demonstrate the efficacy of the proposed model.

READ FULL TEXT
research
05/23/2018

Working Memory Networks: Augmenting Memory Networks with a Relational Reasoning Module

During the last years, there has been a lot of interest in achieving som...
research
09/28/2018

Learning to Remember, Forget and Ignore using Attention Control in Memory

Typical neural networks with external memory do not effectively separate...
research
02/10/2020

Self-Assttentive Associative Memory

Heretofore, neural networks with external memory are restricted to singl...
research
02/10/2020

Self-Attentive Associative Memory

Heretofore, neural networks with external memory are restricted to singl...
research
10/05/2020

Robust High-dimensional Memory-augmented Neural Networks

Traditional neural networks require enormous amounts of data to build th...
research
01/07/2023

A Brain-inspired Memory Transformation based Differentiable Neural Computer for Reasoning-based Question Answering

Reasoning and question answering as a basic cognitive function for human...
research
02/09/2021

Improving Visual Reasoning by Exploiting The Knowledge in Texts

This paper presents a new framework for training image-based classifiers...

Please sign up or login with your details

Forgot password? Click here to reset