Learning Precise Spike Train to Spike Train Transformations in Multilayer Feedforward Neuronal Networks

12/13/2014
by   Arunava Banerjee, et al.
0

We derive a synaptic weight update rule for learning temporally precise spike train to spike train transformations in multilayer feedforward networks of spiking neurons. The framework, aimed at seamlessly generalizing error backpropagation to the deterministic spiking neuron setting, is based strictly on spike timing and avoids invoking concepts pertaining to spike rates or probabilistic models of spiking. The derivation is founded on two innovations. First, an error functional is proposed that compares the spike train emitted by the output neuron of the network to the desired spike train by way of their putative impact on a virtual postsynaptic neuron. This formulation sidesteps the need for spike alignment and leads to closed form solutions for all quantities of interest. Second, virtual assignment of weights to spikes rather than synapses enables a perturbation analysis of individual spike times and synaptic weights of the output as well as all intermediate neurons in the network, which yields the gradients of the error functional with respect to the said entities. Learning proceeds via a gradient descent mechanism that leverages these quantities. Simulation experiments demonstrate the efficacy of the proposed learning framework. The experiments also highlight asymmetries between synapses on excitatory and inhibitory neurons.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
08/08/2017

Learning Feedforward and Recurrent Deterministic Spiking Neuron Network Feedback Controllers

We consider the problem of feedback control when the controller is const...
research
10/23/2018

Training Multilayer Spiking Neural Networks using NormAD based Spatio-Temporal Error Backpropagation

Spiking neural networks (SNNs) have garnered a great amount of interest ...
research
05/08/2020

Learning Precise Spike Timings with Eligibility Traces

Recent research in the field of spiking neural networks (SNNs) has shown...
research
12/07/2012

Spike and Tyke, the Quantized Neuron Model

Modeling spike firing assumes that spiking statistics are Poisson, but r...
research
01/14/2005

Spike timing precision and neural error correction: local behavior

The effects of spike timing precision and dynamical behavior on error co...
research
03/30/2020

Critical Limits in a Bump Attractor Network of Spiking Neurons

A bump attractor network is a model that implements a competitive neuron...
research
11/23/2020

Natural-gradient learning for spiking neurons

In many normative theories of synaptic plasticity, weight updates implic...

Please sign up or login with your details

Forgot password? Click here to reset