Sparse Coding by Spiking Neural Networks: Convergence Theory and Computational Results

05/15/2017
by   Ping Tak Peter Tang, et al.
0

In a spiking neural network (SNN), individual neurons operate autonomously and only communicate with other neurons sparingly and asynchronously via spike signals. These characteristics render a massively parallel hardware implementation of SNN a potentially powerful computer, albeit a non von Neumann one. But can one guarantee that a SNN computer solves some important problems reliably? In this paper, we formulate a mathematical model of one SNN that can be configured for a sparse coding problem for feature extraction. With a moderate but well-defined assumption, we prove that the SNN indeed solves sparse coding. To the best of our knowledge, this is the first rigorous result of this kind.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/10/2017

Bio-Inspired Multi-Layer Spiking Neural Network Extracts Discriminative Features from Speech Signals

Spiking neural networks (SNNs) enable power-efficient implementations du...
research
03/28/2018

On the Algorithmic Power of Spiking Neural Networks

Spiking Neural Networks (SNN) are mathematical models in neuroscience to...
research
03/28/2022

Brain-inspired Multilayer Perceptron with Spiking Neurons

Recently, Multilayer Perceptron (MLP) becomes the hotspot in the field o...
research
03/04/2019

Evolving Spiking Neural Networks for Nonlinear Control Problems

Spiking Neural Networks are powerful computational modelling tools that ...
research
10/13/2017

Efficient Computation in Adaptive Artificial Spiking Neural Networks

Artificial Neural Networks (ANNs) are bio-inspired models of neural comp...
research
05/13/2021

Using ODE waveform-relaxation methods to efficiently include gap junctions in distributed neural network simulations

Waveform-relaxation methods divide systems of differential equations int...
research
08/12/2018

A Basic Compositional Model for Spiking Neural Networks

This paper is part of a project on developing an algorithmic theory of b...

Please sign up or login with your details

Forgot password? Click here to reset