An Approximate Backpropagation Learning Rule for Memristor Based Neural Networks Using Synaptic Plasticity

11/22/2015
by   D. V. Negrov, et al.
0

We describe an approximation to backpropagation algorithm for training deep neural networks, which is designed to work with synapses implemented with memristors. The key idea is to represent the values of both the input signal and the backpropagated delta value with a series of pulses that trigger multiple positive or negative updates of the synaptic weight, and to use the min operation instead of the product of the two signals. In computational simulations, we show that the proposed approximation to backpropagation is well converged and may be suitable for memristor implementations of multilayer neural networks.

READ FULL TEXT
research
05/19/2018

Neural networks with dynamical coefficients and adjustable connections on the basis of integrated backpropagation

We consider artificial neurons which will update their weight coefficien...
research
03/09/2021

Analytically Tractable Inference in Deep Neural Networks

Since its inception, deep learning has been overwhelmingly reliant on ba...
research
09/11/2020

Activation Relaxation: A Local Dynamical Approximation to Backpropagation in the Brain

The backpropagation of error algorithm (backprop) has been instrumental ...
research
11/29/2018

Deep learning for pedestrians: backpropagation in CNNs

The goal of this document is to provide a pedagogical introduction to th...
research
03/26/2023

Lazy learning: a biologically-inspired plasticity rule for fast and energy efficient synaptic plasticity

When training neural networks for classification tasks with backpropagat...
research
06/18/2020

Accelerating Training in Artificial Neural Networks with Dynamic Mode Decomposition

Training of deep neural networks (DNNs) frequently involves optimizing s...
research
10/07/2013

Mean Field Bayes Backpropagation: scalable training of multilayer neural networks with binary weights

Significant success has been reported recently using deep neural network...

Please sign up or login with your details

Forgot password? Click here to reset