Fast and Efficient Asynchronous Neural Computation with Adapting Spiking Neural Networks

09/07/2016
by   Davide Zambrano, et al.
0

Biological neurons communicate with a sparing exchange of pulses - spikes. It is an open question how real spiking neurons produce the kind of powerful neural computation that is possible with deep artificial neural networks, using only so very few spikes to communicate. Building on recent insights in neuroscience, we present an Adapting Spiking Neural Network (ASNN) based on adaptive spiking neurons. These spiking neurons efficiently encode information in spike-trains using a form of Asynchronous Pulsed Sigma-Delta coding while homeostatically optimizing their firing rate. In the proposed paradigm of spiking neuron computation, neural adaptation is tightly coupled to synaptic plasticity, to ensure that downstream neurons can correctly decode upstream spiking neurons. We show that this type of network is inherently able to carry out asynchronous and event-driven neural computation, while performing identical to corresponding artificial neural networks (ANNs). In particular, we show that these adaptive spiking neurons can be drop in replacements for ReLU neurons in standard feedforward ANNs comprised of such units. We demonstrate that this can also be successfully applied to a ReLU based deep convolutional neural network for classifying the MNIST dataset. The ASNN thus outperforms current Spiking Neural Networks (SNNs) implementations, while responding (up to) an order of magnitude faster and using an order of magnitude fewer spikes. Additionally, in a streaming setting where frames are continuously classified, we show that the ASNN requires substantially fewer network updates as compared to the corresponding ANN.

READ FULL TEXT

page 3

page 6

page 7

page 12

research
10/13/2017

Efficient Computation in Adaptive Artificial Spiking Neural Networks

Artificial Neural Networks (ANNs) are bio-inspired models of neural comp...
research
12/18/2014

A theoretical basis for efficient computations with noisy spiking neurons

Network of neurons in the brain apply - unlike processors in our current...
research
09/27/2021

Spiking neural networks trained via proxy

We propose a new learning algorithm to train spiking neural networks (SN...
research
08/28/2010

Spiking Neurons with ASNN Based-Methods for the Neural Block Cipher

Problem statement: This paper examines Artificial Spiking Neural Network...
research
03/14/2023

Emergent Bio-Functional Similarities in a Cortical-Spike-Train-Decoding Spiking Neural Network Facilitate Predictions of Neural Computation

Despite its better bio-plausibility, goal-driven spiking neural network ...
research
09/28/2010

The thermodynamic temperature of a rhythmic spiking network

Artificial neural networks built from two-state neurons are powerful com...
research
01/19/2022

Temporal Computer Organization

This document is focused on computing systems implemented in technologie...

Please sign up or login with your details

Forgot password? Click here to reset