DNN_NeuroSim_V2.0
Benchmark framework of compute-in-memory based accelerators for deep neural network
view repo
DNN+NeuroSim is an integrated framework to benchmark compute-in-memory (CIM) accelerators for deep neural networks, with hierarchical design options from device-level, to circuit-level and up to algorithm-level. A python wrapper is developed to interface NeuroSim with a popular machine learning platform: Pytorch, to support flexible network structures. The framework provides automatic algorithm-to-hardware mapping, and evaluates chip-level area, energy efficiency and throughput for training or inference, as well as training/inference accuracy with hardware constraints. Our prior work (DNN+NeuroSim V1.1) was developed to estimate the impact of reliability in synaptic devices, and analog-to-digital converter (ADC) quantization loss on the accuracy and hardware performance of inference engines. In this work, we further investigated the impact of the analog emerging non-volatile memory non-ideal device properties for on-chip training. By introducing the nonlinearity, asymmetry, device-to-device and cycle-to-cycle variation of weight update into the python wrapper, and peripheral circuits for error/weight gradient computation in NeuroSim core, we benchmarked CIM accelerators based on state-of-the-art SRAM and eNVM devices for VGG-8 on CIFAR-10 dataset, revealing the crucial specs of synaptic devices for on-chip training. The proposed DNN+NeuroSim V2.0 framework is available on GitHub.
READ FULL TEXT
Negative Biased Temperature Instability (NBTI)-induced aging is one of t...
read it
Deep neural networks have achieved impressive results in computer vision...
read it
Resistive crossbars have attracted significant interest in the design of...
read it
We introduce the IBM Analog Hardware Acceleration Kit, a new and first o...
read it
Compute in-memory (CIM) is a promising technique that minimizes data
tra...
read it
In this letter, we quantify the impact of device limitations on the
clas...
read it
The deployment of Deep Neural Networks (DNNs) on end-nodes at the extrem...
read it
Benchmark framework of compute-in-memory based accelerators for deep neural network
Comments
There are no comments yet.