A Hebbian/Anti-Hebbian Network Derived from Online Non-Negative Matrix Factorization Can Cluster and Discover Sparse Features

03/02/2015
by   Cengiz Pehlevan, et al.
0

Despite our extensive knowledge of biophysical properties of neurons, there is no commonly accepted algorithmic theory of neuronal function. Here we explore the hypothesis that single-layer neuronal networks perform online symmetric nonnegative matrix factorization (SNMF) of the similarity matrix of the streamed data. By starting with the SNMF cost function we derive an online algorithm, which can be implemented by a biologically plausible network with local learning rules. We demonstrate that such network performs soft clustering of the data as well as sparse feature discovery. The derived algorithm replicates many known aspects of sensory anatomy and biophysical properties of neurons including unipolar nature of neuronal activity and synaptic weights, local synaptic plasticity rules and the dependence of learning rate on cumulative neuronal activity. Thus, we make a step towards an algorithmic theory of neuronal function, which should facilitate large-scale neural circuit simulations and biologically inspired artificial intelligence.

READ FULL TEXT
research
03/02/2015

A Hebbian/Anti-Hebbian Network for Online Sparse Dictionary Learning Derived from Symmetric Matrix Factorization

Olshausen and Field (OF) proposed that neural computations in the primar...
research
05/12/2014

A Neuron as a Signal Processing Device

A neuron is a basic physiological and computational unit of the brain. W...
research
03/02/2015

A Hebbian/Anti-Hebbian Neural Network for Linear Subspace Learning: A Derivation from Multidimensional Scaling of Streaming Data

Neural network models of early sensory processing typically reduce the d...
research
02/20/2023

A normative framework for deriving neural networks with multi-compartmental neurons and non-Hebbian plasticity

An established normative approach for understanding the algorithmic basi...
research
10/23/2020

A simple normative network approximates local non-Hebbian learning in the cortex

To guide behavior, the brain extracts relevant features from high-dimens...
research
02/04/2019

A Spiking Neural Network with Local Learning Rules Derived From Nonnegative Similarity Matching

The design and analysis of spiking neural network algorithms will be acc...
research
01/07/2014

Cortical prediction markets

We investigate cortical learning from the perspective of mechanism desig...

Please sign up or login with your details

Forgot password? Click here to reset