STDP as presynaptic activity times rate of change of postsynaptic activity

09/19/2015
by   Yoshua Bengio, et al.
0

We introduce a weight update formula that is expressed only in terms of firing rates and their derivatives and that results in changes consistent with those associated with spike-timing dependent plasticity (STDP) rules and biological observations, even though the explicit timing of spikes is not needed. The new rule changes a synaptic weight in proportion to the product of the presynaptic firing rate and the temporal rate of change of activity on the postsynaptic side. These quantities are interesting for studying theoretical explanation for synaptic changes from a machine learning perspective. In particular, if neural dynamics moved neural activity towards reducing some objective function, then this STDP rule would correspond to stochastic gradient descent on that objective function.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/08/2012

Efficient Design of Triplet Based Spike-Timing Dependent Plasticity

Spike-Timing Dependent Plasticity (STDP) is believed to play an importan...
research
11/14/2014

A framework for studying synaptic plasticity with neural spike train data

Learning and memory in the brain are implemented by complex, time-varyin...
research
06/17/2017

Fatiguing STDP: Learning from Spike-Timing Codes in the Presence of Rate Codes

Spiking neural networks (SNNs) could play a key role in unsupervised mac...
research
09/29/2015

Learning dynamic Boltzmann machines with spike-timing dependent plasticity

We propose a particularly structured Boltzmann machine, which we refer t...
research
12/03/2015

Triplet Spike Time Dependent Plasticity: A floating-gate Implementation

Synapse plays an important role of learning in a neural network; the lea...
research
06/13/2017

Temporally Efficient Deep Learning with Spikes

The vast majority of natural sensory data is temporally redundant. Video...
research
11/21/2016

Using inspiration from synaptic plasticity rules to optimize traffic flow in distributed engineered networks

Controlling the flow and routing of data is a fundamental problem in man...

Please sign up or login with your details

Forgot password? Click here to reset