Enabling Resource-Aware Mapping of Spiking Neural Networks via Spatial Decomposition

09/19/2020
by   Adarsha Balaji, et al.
0

With growing model complexity, mapping Spiking Neural Network (SNN)-based applications to tile-based neuromorphic hardware is becoming increasingly challenging. This is because the synaptic storage resources on a tile, viz. a crossbar, can accommodate only a fixed number of pre-synaptic connections per post-synaptic neuron. For complex SNN models that have many pre-synaptic connections per neuron, some connections may need to be pruned after training to fit onto the tile resources, leading to a loss in model quality, e.g., accuracy. In this work, we propose a novel unrolling technique that decomposes a neuron function with many pre-synaptic connections into a sequence of homogeneous neural units, where each neural unit is a function computation node, with two pre-synaptic connections. This spatial decomposition technique significantly improves crossbar utilization and retains all pre-synaptic connections, resulting in no loss of the model quality derived from connection pruning. We integrate the proposed technique within an existing SNN mapping framework and evaluate it using machine learning applications on the DYNAP-SE state-of-the-art neuromorphic hardware. Our results demonstrate an average 60 lower crossbar requirement, 9x higher synapse utilization, 62 energy on the hardware, and between 0.8

READ FULL TEXT

page 1

page 2

page 3

page 4

research
11/27/2020

Compiling Spiking Neural Networks to Mitigate Neuromorphic Hardware Constraints

Spiking Neural Networks (SNNs) are efficient computation models to perfo...
research
04/26/2019

Passive nonlinear dendritic interactions as a general computational resource in functional spiking neural networks

Nonlinear interactions in the dendritic tree play a key role in neural c...
research
02/25/2020

Evaluating complexity and resilience trade-offs in emerging memory inference machines

Neuromorphic-style inference only works well if limited hardware resourc...
research
02/11/2023

Synaptic Stripping: How Pruning Can Bring Dead Neurons Back To Life

Rectified Linear Units (ReLU) are the default choice for activation func...
research
01/16/2016

TrueHappiness: Neuromorphic Emotion Recognition on TrueNorth

We present an approach to constructing a neuromorphic device that respon...
research
08/26/2017

TraNNsformer: Neural Network Transformation for Memristive Crossbar based Neuromorphic System Design

Implementation of Neuromorphic Systems using post Complementary Metal-Ox...
research
01/11/2022

Neural Capacitance: A New Perspective of Neural Network Selection via Edge Dynamics

Efficient model selection for identifying a suitable pre-trained neural ...

Please sign up or login with your details

Forgot password? Click here to reset