Towards Modular Algorithm Induction

02/27/2020
by   Daniel A. Abolafia, et al.
0

We present a modular neural network architecture Main that learns algorithms given a set of input-output examples. Main consists of a neural controller that interacts with a variable-length input tape and learns to compose modules together with their corresponding argument choices. Unlike previous approaches, Main uses a general domain-agnostic mechanism for selection of modules and their arguments. It uses a general input tape layout together with a parallel history tape to indicate most recently used locations. Finally, it uses a memoryless controller with a length-invariant self-attention based input tape encoding to allow for random access to tape locations. The Main architecture is trained end-to-end using reinforcement learning from a set of input-output examples. We evaluate Main on five algorithmic tasks and show that it can learn policies that generalizes perfectly to inputs of much longer lengths than the ones used for training.

READ FULL TEXT
research
11/06/2016

Neuro-Symbolic Program Synthesis

Recent years have seen the proposal of a number of neural architectures ...
research
11/23/2015

Learning Simple Algorithms from Examples

We present an approach for learning simple algorithms such as copying, m...
research
11/19/2015

Neural Random-Access Machines

In this paper, we propose and investigate a new neural network architect...
research
04/15/2020

Improving Input-Output Linearizing Controllers for Bipedal Robots via Reinforcement Learning

The main drawbacks of input-output linearizing controllers are the need ...
research
06/09/2015

Pointer Networks

We introduce a new neural architecture to learn the conditional probabil...
research
05/28/2019

Differentiable Algorithm Networks for Composable Robot Learning

This paper introduces the Differentiable Algorithm Network (DAN), a comp...
research
03/01/2019

GRP Model for Sensorimotor Learning

Learning from complex demonstrations is challenging, especially when the...

Please sign up or login with your details

Forgot password? Click here to reset