Domain Wall Leaky Integrate-and-Fire Neurons with Shape-Based Configurable Activation Functions

11/11/2020
by   Wesley H. Brigner, et al.
10

Complementary metal oxide semiconductor (CMOS) devices display volatile characteristics, and are not well suited for analog applications such as neuromorphic computing. Spintronic devices, on the other hand, exhibit both non-volatile and analog features, which are well-suited to neuromorphic computing. Consequently, these novel devices are at the forefront of beyond-CMOS artificial intelligence applications. However, a large quantity of these artificial neuromorphic devices still require the use of CMOS, which decreases the efficiency of the system. To resolve this, we have previously proposed a number of artificial neurons and synapses that do not require CMOS for operation. Although these devices are a significant improvement over previous renditions, their ability to enable neural network learning and recognition is limited by their intrinsic activation functions. This work proposes modifications to these spintronic neurons that enable configuration of the activation functions through control of the shape of a magnetic domain wall track. Linear and sigmoidal activation functions are demonstrated in this work, which can be extended through a similar approach to enable a wide variety of activation functions.

READ FULL TEXT

page 4

page 5

research
11/07/2021

Biologically Inspired Oscillating Activation Functions Can Bridge the Performance Gap between Biological and Artificial Neurons

Nonlinear activation functions endow neural networks with the ability to...
research
06/28/2023

Empirical Loss Landscape Analysis of Neural Network Activation Functions

Activation functions play a significant role in neural network design by...
research
11/22/2021

Shape-Dependent Multi-Weight Magnetic Artificial Synapses for Neuromorphic Computing

In neuromorphic computing, artificial synapses provide a multi-weight co...
research
01/08/2021

Controllable reset behavior in domain wall-magnetic tunnel junction artificial neurons for task-adaptable computation

Neuromorphic computing with spintronic devices has been of interest due ...
research
02/21/2023

Unification of popular artificial neural network activation functions

We present a unified representation of the most popular neural network a...
research
03/24/2020

Unsupervised Competitive Hardware Learning Rule for Spintronic Clustering Architecture

We propose a hardware learning rule for unsupervised clustering within a...

Please sign up or login with your details

Forgot password? Click here to reset