Current-mode Memristor Crossbars for Neuromemristive Systems

07/17/2017
by   Cory Merkel, et al.
0

Motivated by advantages of current-mode design, this brief contribution explores the implementation of weight matrices in neuromemristive systems via current-mode memristor crossbar circuits. After deriving theoretical results for the range and distribution of weights in the current-mode design, it is shown that any weight matrix based on voltage-mode crossbars can be mapped to a current-mode crossbar if the voltage-mode weights are carefully bounded. Then, a modified gradient descent rule is derived for the current-mode design that can be used to perform backpropagation training. Behavioral simulations on the MNIST dataset indicate that both voltage and current-mode designs are able to achieve similar accuracy and have similar defect tolerance. However, analysis of trained weight distributions reveals that current-mode and voltage-mode designs may use different feature representations.

READ FULL TEXT
research
02/17/2022

Gradients without Backpropagation

Using backpropagation to compute gradients of objective functions for op...
research
09/01/2021

Is the mode elicitable relative to unimodal distributions?

Statistical functionals are called elicitable if there exists a loss or ...
research
08/21/2022

Emergence of hierarchical modes from deep learning

Large-scale deep neural networks consume expensive training costs, but t...
research
04/17/2017

Learning Linear Feature Space Transformations in Symbolic Regression

We propose a new type of leaf node for use in Symbolic Regression (SR) t...
research
03/09/2021

Dynamic Range Mode Enumeration

The range mode problem is a fundamental problem and there is a lot of wo...
research
08/29/2019

Spectral Regularization for Combating Mode Collapse in GANs

Despite excellent progress in recent years, mode collapse remains a majo...
research
07/13/2021

Tourbillon: a Physically Plausible Neural Architecture

In a physical neural system, backpropagation is faced with a number of o...

Please sign up or login with your details

Forgot password? Click here to reset