A biologically plausible neural network for local supervision in cortical microcircuits

11/30/2020
by   Siavash Golkar, et al.
0

The backpropagation algorithm is an invaluable tool for training artificial neural networks; however, because of a weight sharing requirement, it does not provide a plausible model of brain function. Here, in the context of a two-layer network, we derive an algorithm for training a neural network which avoids this problem by not requiring explicit error computation and backpropagation. Furthermore, our algorithm maps onto a neural network that bears a remarkable resemblance to the connectivity structure and learning rules of the cortex. We find that our algorithm empirically performs comparably to backprop on a number of datasets.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/07/2023

Correlative Information Maximization: A Biologically Plausible Approach to Supervised Deep Neural Networks without Weight Symmetry

The backpropagation algorithm has experienced remarkable success in trai...
research
10/07/2020

From Artificial Intelligence to Brain Intelligence: The basis learning and memory algorithm for brain-like intelligence

The algorithm of brain learning and memory is still undetermined. The ba...
research
02/09/2023

SparseProp: Efficient Sparse Backpropagation for Faster Training of Neural Networks

We provide a new efficient version of the backpropagation algorithm, spe...
research
06/11/2020

GAIT-prop: A biologically plausible learning rule derived from backpropagation of error

Traditional backpropagation of error, though a highly successful algorit...
research
10/23/2020

A biologically plausible neural network for Slow Feature Analysis

Learning latent features from time series data is an important problem i...
research
04/01/2022

Physical Deep Learning with Biologically Plausible Training Method

The ever-growing demand for further advances in artificial intelligence ...
research
10/13/2020

Investigating the Scalability and Biological Plausibility of the Activation Relaxation Algorithm

The recently proposed Activation Relaxation (AR) algorithm provides a si...

Please sign up or login with your details

Forgot password? Click here to reset