Working memory facilitates reward-modulated Hebbian learning in recurrent neural networks

10/23/2019
by   Roman Pogodin, et al.
0

Reservoir computing is a powerful tool to explain how the brain learns temporal sequences, such as movements, but existing learning schemes are either biologically implausible or too inefficient to explain animal performance. We show that a network can learn complicated sequences with a reward-modulated Hebbian learning rule if the network of reservoir neurons is combined with a second network that serves as a dynamic working memory and provides a spatio-temporal backbone signal to the reservoir. In combination with the working memory, reward-modulated Hebbian learning of the readout neurons performs as well as FORCE learning, but with the advantage of a biologically plausible interpretation of both the learning rule and the learning paradigm.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/13/2020

Deep Reservoir Networks with Learned Hidden Reservoir Weights using Direct Feedback Alignment

Deep Reservoir Computing has emerged as a new paradigm for deep learning...
research
03/08/2018

A model of reward-modulated motor learning with parallelcortical and basal ganglia pathways

Many recent studies of the motor system are divided into two distinct ap...
research
06/07/2021

One-shot learning of paired associations by a reservoir computing model with Hebbian plasticity

One-shot learning can be achieved by algorithms and animals, but how the...
research
10/12/2012

Autonomous Reinforcement of Behavioral Sequences in Neural Dynamics

We introduce a dynamic neural algorithm called Dynamic Neural (DN) SARSA...
research
04/05/2022

From implicit learning to explicit representations

Using the reservoir computing framework, we demonstrate how a simple mod...
research
01/17/2020

A Robust Model of Gated Working Memory

Gated working memory is defined as the capacity of holding arbitrary inf...
research
06/18/2018

A Simple Reservoir Model of Working Memory with Real Values

The prefrontal cortex is known to be involved in many high-level cogniti...

Please sign up or login with your details

Forgot password? Click here to reset