Programming Patterns in Dataflow Matrix Machines and Generalized Recurrent Neural Nets

06/30/2016
by   Michael Bukatin, et al.
0

Dataflow matrix machines arise naturally in the context of synchronous dataflow programming with linear streams. They can be viewed as a rather powerful generalization of recurrent neural networks. Similarly to recurrent neural networks, large classes of dataflow matrix machines are described by matrices of numbers, and therefore dataflow matrix machines can be synthesized by computing their matrices. At the same time, the evidence is fairly strong that dataflow matrix machines have sufficient expressive power to be a convenient general-purpose programming platform. Because of the network nature of this platform, programming patterns often correspond to patterns of connectivity in the generalized recurrent neural networks understood as programs. This paper explores a variety of such programming patterns.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/17/2016

Dataflow matrix machines as programmable, dynamically expandable, self-referential generalized recurrent neural networks

Dataflow matrix machines are a powerful generalization of recurrent neur...
research
05/03/2017

Dataflow Matrix Machines as a Model of Computations with Linear Streams

We overview dataflow matrix machines as a Turing complete generalization...
research
12/20/2017

Dataflow Matrix Machines and V-values: a Bridge between Programs and Neural Nets

Dataflow matrix machines generalize neural nets by replacing streams of ...
research
03/29/2016

Dataflow Matrix Machines as a Generalization of Recurrent Neural Networks

Dataflow matrix machines are a powerful generalization of recurrent neur...
research
07/16/2021

Controlling Recurrent Neural Networks by Diagonal Conceptors

The human brain is capable of learning, memorizing, and regenerating a p...
research
04/27/2022

Machines of finite depth: towards a formalization of neural networks

We provide a unifying framework where artificial neural networks and the...
research
11/18/2019

Radar Emitter Classification with Attribute-specific Recurrent Neural Networks

Radar pulse streams exhibit increasingly complex temporal patterns and c...

Please sign up or login with your details

Forgot password? Click here to reset