Supervised Learning in Spiking Neural Networks with Phase-Change Memory Synapses

05/28/2019
by   S. R. Nandakumar, et al.
0

Spiking neural networks (SNN) are artificial computational models that have been inspired by the brain's ability to naturally encode and process information in the time domain. The added temporal dimension is believed to render them more computationally efficient than the conventional artificial neural networks, though their full computational capabilities are yet to be explored. Recently, computational memory architectures based on non-volatile memory crossbar arrays have shown great promise to implement parallel computations in artificial and spiking neural networks. In this work, we experimentally demonstrate for the first time, the feasibility to realize high-performance event-driven in-situ supervised learning systems using nanoscale and stochastic phase-change synapses. Our SNN is trained to recognize audio signals of alphabets encoded using spikes in the time domain and to generate spike trains at precise time instances to represent the pixel intensities of their corresponding images. Moreover, with a statistical model capturing the experimental behavior of the devices, we investigate architectural and systems-level solutions for improving the training and inference performance of our computational memory-based system. Combining the computational potential of supervised SNNs with the parallel compute power of computational memory, the work paves the way for next-generation of efficient brain-inspired systems.

READ FULL TEXT

page 3

page 5

page 7

research
10/16/2019

The Heidelberg spiking datasets for the systematic evaluation of spiking neural networks

Spiking neural networks are the basis of versatile and power-efficient i...
research
04/22/2018

Deep Learning in Spiking Neural Networks

Deep learning approaches have shown remarkable performance in many areas...
research
04/12/2022

A Robust Learning Rule for Soft-Bounded Memristive Synapses Competitive with Supervised Learning in Standard Spiking Neural Networks

Memristive devices are a class of circuit elements that shows great prom...
research
06/19/2020

Oscillatory background activity implements a backbone for sampling-based computations in spiking neural networks

Various data suggest that the brain carries out probabilistic inference....
research
10/14/2020

Analogical and Relational Reasoning with Spiking Neural Networks

Raven's Progressive Matrices have been widely used for measuring abstrac...
research
11/09/2022

In-memory factorization of holographic perceptual representations

Disentanglement of constituent factors of a sensory signal is central to...
research
01/31/2023

Spyker: High-performance Library for Spiking Deep Neural Networks

Spiking neural networks (SNNs) have been recently brought to light due t...

Please sign up or login with your details

Forgot password? Click here to reset