A Spiking Neural Network with Local Learning Rules Derived From Nonnegative Similarity Matching

02/04/2019
by   Cengiz Pehlevan, et al.
0

The design and analysis of spiking neural network algorithms will be accelerated by the advent of new theoretical approaches. In an attempt at such approach, we provide a principled derivation of a spiking algorithm for unsupervised learning, starting from the nonnegative similarity matching cost function. The resulting network consists of integrate-and-fire units and exhibits local learning rules, making it biologically plausible and also suitable for neuromorphic hardware. We show in simulations that the algorithm can perform sparse feature extraction and manifold learning, two tasks which can be formulated as nonnegative similarity matching problems.

READ FULL TEXT

page 1

page 2

page 3

page 4

page 5

research
08/05/2019

Neuroscience-inspired online unsupervised learning algorithms

Although the currently popular deep learning networks achieve unpreceden...
research
02/21/2017

Online Representation Learning with Multi-layer Hebbian Networks for Image Classification Tasks

Unsupervised learning permits the development of algorithms that are abl...
research
02/24/2022

Evolving-to-Learn Reinforcement Learning Tasks with Spiking Neural Networks

Inspired by the natural nervous system, synaptic plasticity rules are ap...
research
02/20/2023

A normative framework for deriving neural networks with multi-compartmental neurons and non-Hebbian plasticity

An established normative approach for understanding the algorithmic basi...
research
02/10/2021

A Neural Network with Local Learning Rules for Minor Subspace Analysis

The development of neuromorphic hardware and modeling of biological neur...
research
02/10/2021

A Similarity-preserving Neural Network Trained on Transformed Images Recapitulates Salient Features of the Fly Motion Detection Circuit

Learning to detect content-independent transformations from data is one ...
research
03/02/2015

A Hebbian/Anti-Hebbian Network Derived from Online Non-Negative Matrix Factorization Can Cluster and Discover Sparse Features

Despite our extensive knowledge of biophysical properties of neurons, th...

Please sign up or login with your details

Forgot password? Click here to reset