Hardware calibrated learning to compensate heterogeneity in analog RRAM-based Spiking Neural Networks

02/10/2022
by   Filippo Moro, et al.
0

Spiking Neural Networks (SNNs) can unleash the full power of analog Resistive Random Access Memories (RRAMs) based circuits for low power signal processing. Their inherent computational sparsity naturally results in energy efficiency benefits. The main challenge implementing robust SNNs is the intrinsic variability (heterogeneity) of both analog CMOS circuits and RRAM technology. In this work, we assessed the performance and variability of RRAM-based neuromorphic circuits that were designed and fabricated using a 130 nm technology node. Based on these results, we propose a Neuromorphic Hardware Calibrated (NHC) SNN, where the learning circuits are calibrated on the measured data. We show that by taking into account the measured heterogeneity characteristics in the off-chip learning phase, the NHC SNN self-corrects its hardware non-idealities and learns to solve benchmark tasks with high accuracy. This work demonstrates how to cope with the heterogeneity of neurons and synapses for increasing classification accuracy in temporal tasks.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/28/2019

Harnessing Slow Dynamics in Neuromorphic Computation

Neuromorphic Computing is a nascent research field in which models and d...
research
06/12/2020

Training spiking multi-layer networks with surrogate gradients on an analog neuromorphic substrate

Spiking neural networks are nature's solution for parallel information p...
research
02/28/2019

Application-level Studies of Cellular Neural Network-based Hardware Accelerators

As cost and performance benefits associated with Moore's Law scaling slo...
research
06/23/2020

Inference with Artificial Neural Networks on Analog Neuromorphic Hardware

The neuromorphic BrainScaleS-2 ASIC comprises mixed-signal neurons and s...
research
08/25/2022

CMOS-based area-and-power-efficient neuron and synapse circuits for time-domain analog spiking neural networks

Conventional neural structures tend to communicate through analog quanti...
research
12/10/2021

Synchronous Unsupervised STDP Learning with Stochastic STT-MRAM Switching

The use of analog resistance states for storing weights in neuromorphic ...
research
07/12/2017

Capacity, Fidelity, and Noise Tolerance of Associative Spatial-Temporal Memories Based on Memristive Neuromorphic Network

We have calculated the key characteristics of associative (content-addre...

Please sign up or login with your details

Forgot password? Click here to reset