A Supervised Learning Algorithm for Multilayer Spiking Neural Networks Based on Temporal Coding Toward Energy-Efficient VLSI Processor Design

01/08/2020
by   Yusuke Sakemi, et al.
0

Spiking neural networks (SNNs) are brain-inspired mathematical models with the ability to process information in the form of spikes. SNNs are expected to provide not only new machine-learning algorithms, but also energy-efficient computational models when implemented in VLSI circuits. In this paper, we propose a novel supervised learning algorithm for SNNs based on temporal coding. A spiking neuron in this algorithm is designed to facilitate analog VLSI implementations with analog resistive memory, by which ultra-high energy efficiency can be achieved. We also propose several techniques to improve the performance on a recognition task, and show that the classification accuracy of the proposed algorithm is as high as that of the state-of-the-art temporal coding SNN algorithms on the MNIST dataset. Finally, we discuss the robustness of the proposed SNNs against variations that arise from the device manufacturing process and are unavoidable in analog VLSI implementation. We also propose a technique to suppress the effects of variations in the manufacturing process on the recognition performance.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/18/2021

Effects of VLSI Circuit Constraints on Temporal-Coding Multilayer Spiking Neural Networks

The spiking neural network (SNN) has been attracting considerable attent...
research
03/07/2022

An STDP-Based Supervised Learning Algorithm for Spiking Neural Networks

Compared with rate-based artificial neural networks, Spiking Neural Netw...
research
09/24/2019

Direct training based spiking convolutional neural networks for object recognition

Direct training based spiking neural networks (SNNs) have been paid a lo...
research
01/31/2022

Rate Coding or Direct Coding: Which One is Better for Accurate, Robust, and Energy-efficient Spiking Neural Networks?

Recent Spiking Neural Networks (SNNs) works focus on an image classifica...
research
04/12/2022

A Robust Learning Rule for Soft-Bounded Memristive Synapses Competitive with Supervised Learning in Standard Spiking Neural Networks

Memristive devices are a class of circuit elements that shows great prom...
research
09/13/2011

Developing a supervised training algorithm for limited precision feed-forward spiking neural networks

Spiking neural networks have been referred to as the third generation of...
research
08/28/2022

Scalable Nanophotonic-Electronic Spiking Neural Networks

Spiking neural networks (SNN) provide a new computational paradigm capab...

Please sign up or login with your details

Forgot password? Click here to reset