TCL: an ANN-to-SNN Conversion with Trainable Clipping Layers

08/11/2020
by   Nguyen-Dong Ho, et al.
0

Spiking Neural Networks (SNNs) provide significantly lower power dissipationthan deep neural networks (DNNs), called as analog neural networks (ANNs) inthis work. Conventionally, SNNs have failed to arrive at the training accuraciesof ANNs. However, several recent researches have shown that this challenge canbe addressed by converting ANN to SNN instead of the direct training of SNNs.Nonetheless, the large latency of SNNs still limits their application, more prob-lematic for large size datasets such as Imagenet. It is challenging to overcome thisproblem since in SNNs, there is the trade-off relation between their accuracy and la-tency. In this work, we elegantly alleviate the problem by using a trainable clippinglayers, so called TCL. By combining the TCL with traditional data-normalizationtechniques, we respectively obtain 71.12 after the ANN to SNN conversion with the latency constraint of250 cycles.

READ FULL TEXT

Authors

page 1

page 2

page 3

page 4

02/03/2022

Optimized Potential Initialization for Low-latency Spiking Neural Networks

Spiking Neural Networks (SNNs) have been attached great importance due t...
05/25/2021

Optimal ANN-SNN Conversion for Fast and Accurate Inference in Deep Spiking Neural Networks

Spiking Neural Networks (SNNs), as bio-inspired energy-efficient neural ...
12/30/2019

Recognizing Images with at most one Spike per Neuron

In order to port the performance of trained artificial neural networks (...
09/22/2018

The Optimal ANN Model for Predicting Bearing Capacity of Shallow Foundations Trained on Scarce Data

This study is focused on determining the potential of using deep neural ...
05/17/2019

How Case Based Reasoning Explained Neural Networks: An XAI Survey of Post-Hoc Explanation-by-Example in ANN-CBR Twins

This paper surveys an approach to the XAI problem, using post-hoc explan...
05/14/2022

Spiking Approximations of the MaxPooling Operation in Deep SNNs

Spiking Neural Networks (SNNs) are an emerging domain of biologically in...
10/01/2021

One Timestep is All You Need: Training Spiking Neural Networks with Ultra Low Latency

Spiking Neural Networks (SNNs) are energy efficient alternatives to comm...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.