Efficient Spiking Neural Networks with Radix Encoding

05/14/2021

∙

Spiking neural networks (SNNs) have advantages in latency and energy efficiency over traditional artificial neural networks (ANNs) due to its event-driven computation mechanism and replacement of energy-consuming weight multiplications with additions. However, in order to reach accuracy of its ANN counterpart, it usually requires long spike trains to ensure the accuracy. Traditionally, a spike train needs around one thousand time steps to approach similar accuracy as its ANN counterpart. This offsets the computation efficiency brought by SNNs because longer spike trains mean a larger number of operations and longer latency. In this paper, we propose a radix encoded SNN with ultra-short spike trains. In the new model, the spike train takes less than ten time steps. Experiments show that our method demonstrates 25X speedup and 1.1 VGG-16 network architecture and CIFAR-10 dataset.

READ FULL TEXT

Efficient Spiking Neural Networks with Radix Encoding

SNN2ANN: A Fast and Memory-Efficient Training Framework for Spiking Neural Networks

Two-Step Spike Encoding Scheme and Architecture for Highly Sparse Spiking-Neural-Network

An Adaptive Sampling and Edge Detection Approach for Encoding Static Images for Spiking Neural Networks

Emergent Bio-Functional Similarities in a Cortical-Spike-Train-Decoding Spiking Neural Network Facilitate Predictions of Neural Computation

Training High-Performance Low-Latency Spiking Neural Networks by Differentiation on Spike Representation

Input-Aware Dynamic Timestep Spiking Neural Networks for Efficient In-Memory Computing

MT-SNN: Enhance Spiking Neural Network with Multiple Thresholds

Efficient Spiking Neural Networks with Radix Encoding

Related Research

SNN2ANN: A Fast and Memory-Efficient Training Framework for Spiking Neural Networks

Two-Step Spike Encoding Scheme and Architecture for Highly Sparse Spiking-Neural-Network

An Adaptive Sampling and Edge Detection Approach for Encoding Static Images for Spiking Neural Networks

Emergent Bio-Functional Similarities in a Cortical-Spike-Train-Decoding Spiking Neural Network Facilitate Predictions of Neural Computation

Training High-Performance Low-Latency Spiking Neural Networks by Differentiation on Spike Representation

Input-Aware Dynamic Timestep Spiking Neural Networks for Efficient In-Memory Computing

MT-SNN: Enhance Spiking Neural Network with Multiple Thresholds