Neural Random-Access Machines

11/19/2015
by   Karol Kurach, et al.
0

In this paper, we propose and investigate a new neural network architecture called Neural Random Access Machine. It can manipulate and dereference pointers to an external variable-size random-access memory. The model is trained from pure input-output examples using backpropagation. We evaluate the new model on a number of simple algorithmic tasks whose solutions require pointer manipulation and dereferencing. Our results show that the proposed model can learn to solve algorithmic tasks of such type and is capable of operating on simple data structures like linked-lists and binary trees. For easier tasks, the learned solutions generalize to sequences of arbitrary length. Moreover, memory access during inference can be done in a constant time under some assumptions.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
09/12/2022

Type checking data structures more complex than trees

Graphs are a generalized concept that encompasses more complex data stru...
research
02/27/2020

Towards Modular Algorithm Induction

We present a modular neural network architecture Main that learns algori...
research
11/09/2016

Lie-Access Neural Turing Machines

External neural memory structures have recently become a popular tool fo...
research
10/30/2019

Learning Algorithmic Solutions to Symbolic Planning Tasks with a Neural Computer

A key feature of intelligent behavior is the ability to learn abstract s...
research
07/07/2021

Differentiable Random Access Memory using Lattices

We introduce a differentiable random access memory module with O(1) perf...
research
03/18/2020

Progress Extrapolating Algorithmic Learning to Arbitrary Sequence Lengths

Recent neural network models for algorithmic tasks have led to significa...
research
10/18/2021

State-Space Constraints Improve the Generalization of the Differentiable Neural Computer in some Algorithmic Tasks

Memory-augmented neural networks (MANNs) can solve algorithmic tasks lik...

Please sign up or login with your details

Forgot password? Click here to reset