DeepAI
Log In Sign Up

A simple normative network approximates local non-Hebbian learning in the cortex

10/23/2020
by   Siavash Golkar, et al.
0

To guide behavior, the brain extracts relevant features from high-dimensional data streamed by sensory organs. Neuroscience experiments demonstrate that the processing of sensory inputs by cortical neurons is modulated by instructive signals which provide context and task-relevant information. Here, adopting a normative approach, we model these instructive signals as supervisory inputs guiding the projection of the feedforward data. Mathematically, we start with a family of Reduced-Rank Regression (RRR) objective functions which include Reduced Rank (minimum) Mean Square Error (RRMSE) and Canonical Correlation Analysis (CCA), and derive novel offline and online optimization algorithms, which we call Bio-RRR. The online algorithms can be implemented by neural networks whose synaptic learning rules resemble calcium plateau potential dependent plasticity observed in the cortex. We detail how, in our model, the calcium plateau potential can be interpreted as a backpropagating error signal. We demonstrate that, despite relying exclusively on biologically plausible local learning rules, our algorithms perform competitively with existing implementations of RRMSE and CCA.

READ FULL TEXT

page 1

page 2

page 3

page 4

10/01/2020

A biologically plausible neural network for multi-channel Canonical Correlation Analysis

Cortical pyramidal neurons receive inputs from multiple distinct neural ...
11/30/2015

Optimization theory of Hebbian/anti-Hebbian networks for PCA and whitening

In analyzing information streamed by sensory organs, our brains face cha...
11/30/2015

A Normative Theory of Adaptive Dimensionality Reduction in Neural Networks

To make sense of the world our brains must analyze high-dimensional data...
08/05/2019

Neuroscience-inspired online unsupervised learning algorithms

Although the currently popular deep learning networks achieve unpreceden...
07/15/2022

Context-sensitive neocortical neurons transform the effectiveness and efficiency of neural information processing

There is ample neurobiological evidence that context-sensitive neocortic...