Control of synaptic plasticity in neural networks

03/10/2023
by   Mohammad Modiri, et al.
0

The brain is a nonlinear and highly Recurrent Neural Network (RNN). This RNN is surprisingly plastic and supports our astonishing ability to learn and execute complex tasks. However, learning is incredibly complicated due to the brain's nonlinear nature and the obscurity of mechanisms for determining the contribution of each synapse to the output error. This issue is known as the Credit Assignment Problem (CAP) and is a fundamental challenge in neuroscience and Artificial Intelligence (AI). Nevertheless, in the current understanding of cognitive neuroscience, it is widely accepted that a feedback loop systems play an essential role in synaptic plasticity. With this as inspiration, we propose a computational model by combining Neural Networks (NN) and nonlinear optimal control theory. The proposed framework involves a new NN-based actor-critic method which is used to simulate the error feedback loop systems and projections on the NN's synaptic plasticity so as to ensure that the output error is minimized.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/26/2023

Control of synaptic plasticity via the fusion of reinforcement learning and unsupervised learning in neural networks

The brain can learn to execute a wide variety of tasks quickly and effic...
research
06/15/2021

Credit Assignment in Neural Networks through Deep Feedback Control

The success of deep learning sparked interest in whether the brain learn...
research
10/28/2021

Learning to Control using Image Feedback

Learning to control complex systems using non-traditional feedback, e.g....
research
04/03/2021

Explanatory models in neuroscience: Part 2 – constraint-based intelligibility

Computational modeling plays an increasingly important role in neuroscie...
research
08/18/2020

Efficient planning of peen-forming patterns via artificial neural networks

Robust automation of the shot peen forming process demands a closed-loop...
research
03/03/2020

Embodied Synaptic Plasticity with Online Reinforcement learning

The endeavor to understand the brain involves multiple collaborating res...

Please sign up or login with your details

Forgot password? Click here to reset