A biologically plausible neural network for multi-channel Canonical Correlation Analysis

10/01/2020
by   David Lipshutz, et al.
31

Cortical pyramidal neurons receive inputs from multiple distinct neural populations and integrate these inputs in separate dendritic compartments. We explore the possibility that cortical microcircuits implement Canonical Correlation Analysis (CCA), an unsupervised learning method that projects the inputs onto a common subspace so as to maximize the correlations between the projections. To this end, we seek a multi-channel CCA algorithm that can be implemented in a biologically plausible neural network. For biological plausibility, we require that the network operates in the online setting and its synaptic update rules are local. Starting from a novel CCA objective function, we derive an online optimization algorithm whose optimization steps can be implemented in a single-layer neural network with multi-compartmental neurons and local non-Hebbian learning rules. We also derive an extension of our online CCA algorithm with adaptive output rank and output whitening. Interestingly, the extension maps onto a neural network whose neural architecture and synaptic updates resemble neural circuitry and synaptic plasticity observed experimentally in cortical pyramidal neurons.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
11/17/2021

A Normative and Biologically Plausible Algorithm for Independent Component Analysis

The brain effortlessly solves blind source separation (BSS) problems, bu...
research
10/23/2020

A simple normative network approximates local non-Hebbian learning in the cortex

To guide behavior, the brain extracts relevant features from high-dimens...
research
10/23/2020

A biologically plausible neural network for Slow Feature Analysis

Learning latent features from time series data is an important problem i...
research
05/28/2019

Using local plasticity rules to train recurrent neural networks

To learn useful dynamics on long time scales, neurons must use plasticit...
research
10/23/2012

A Self-Organized Neural Comparator

Learning algorithms need generally the possibility to compare several st...
research
01/27/2023

Statistical whitening of neural populations with gain-modulating interneurons

Statistical whitening transformations play a fundamental role in many co...
research
03/02/2015

A Hebbian/Anti-Hebbian Network for Online Sparse Dictionary Learning Derived from Symmetric Matrix Factorization

Olshausen and Field (OF) proposed that neural computations in the primar...

Please sign up or login with your details

Forgot password? Click here to reset