Comparison of Update and Genetic Training Algorithms in a Memristor Crossbar Perceptron

12/10/2020
by   Kyle N. Edwards, et al.
0

Memristor-based computer architectures are becoming more attractive as a possible choice of hardware for the implementation of neural networks. However, at present, memristor technologies are susceptible to a variety of failure modes, a serious concern in any application where regular access to the hardware may not be expected or even possible. In this study, we investigate whether certain training algorithms may be more resilient to particular hardware failure modes, and therefore more suitable for use in those applications. We implement two training algorithms – a local update scheme and a genetic algorithm – in a simulated memristor crossbar, and compare their ability to train for a simple image classification task as an increasing number of memristors fail to adjust their conductance. We demonstrate that there is a clear distinction between the two algorithms in several measures of the rate of failure to train.

READ FULL TEXT
research
10/29/2020

Understanding the Failure Modes of Out-of-Distribution Generalization

Empirical studies suggest that machine learning models often rely on fea...
research
02/09/2018

Fibres of Failure: Classifying errors in predictive processes

We describe Fibres of Failure (FiFa), a method to classify failure modes...
research
12/03/2003

Failure-Free Genetic Algorithm Optimization of a System Controller Using SAFE/LEARNING Controllers in Tandem

The paper presents a method for failure free genetic algorithm optimizat...
research
04/19/2010

Genetic Algorithms for Multiple-Choice Problems

This thesis investigates the use of problem-specific knowledge to enhanc...
research
07/26/2013

Finite State Machine Synthesis for Evolutionary Hardware

This article considers application of genetic algorithms for finite mach...
research
10/29/2021

UDIS: Unsupervised Discovery of Bias in Deep Visual Recognition Models

Deep learning models have been shown to learn spurious correlations from...
research
09/02/2021

Characterizing possible failure modes in physics-informed neural networks

Recent work in scientific machine learning has developed so-called physi...

Please sign up or login with your details

Forgot password? Click here to reset