A model of reward-modulated motor learning with parallelcortical and basal ganglia pathways

03/08/2018
by   Ryan Pyle, et al.
0

Many recent studies of the motor system are divided into two distinct approaches: Those that investigate how motor responses are encoded in cortical neurons' firing rate dynamics and those that study the learning rules by which mammals and songbirds develop reliable motor responses. Computationally, the first approach is encapsulated by reservoir computing models, which can learn intricate motor tasks and produce internal dynamics strikingly similar to those of motor cortical neurons, but rely on biologically unrealistic learning rules. The more realistic learning rules developed by the second approach are often derived for simplified, discrete tasks in contrast to the intricate dynamics that characterize real motor responses. We bridge these two approaches to develop a biologically realistic learning rule for reservoir computing. Our algorithm learns simulated motor tasks on which previous reservoir computing algorithms fail, and reproduces experimental findings including those that relate motor learning to Parkinson's disease and its treatment.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/23/2019

Working memory facilitates reward-modulated Hebbian learning in recurrent neural networks

Reservoir computing is a powerful tool to explain how the brain learns t...
research
06/20/2020

Functional differentiations in evolutionary reservoir computing networks

We propose an extended reservoir computer that shows the functional diff...
research
08/21/2021

Reservoir Computing with Diverse Timescales for Prediction of Multiscale Dynamics

Machine learning approaches have recently been leveraged as a substitute...
research
09/25/2016

Learning by Stimulation Avoidance: A Principle to Control Spiking Neural Networks Dynamics

Learning based on networks of real neurons, and by extension biologicall...
research
12/13/2013

Parkinson's Disease Motor Symptoms in Machine Learning: A Review

This paper reviews related work and state-of-the-art publications for re...
research
02/14/2020

Mapping Motor Cortex Stimulation to Muscle Responses: A Deep Neural Network Modeling Approach

A deep neural network (DNN) that can reliably model muscle responses fro...
research
04/28/2023

Threat Perception Modulation by Capturing Emotion, Motor and Empathetic System Responses: A Systematic Review

The fight or flight phenomena is of evolutionary origin and responsible ...

Please sign up or login with your details

Forgot password? Click here to reset