Neural Network-Hardware Co-design for Scalable RRAM-based BNN Accelerators

11/06/2018
by   Yulhwa Kim, et al.
0

Recently, RRAM-based Binary Neural Network (BNN) hardware has been gaining interests as it requires 1-bit sense-amp only and eliminates the need for high-resolution ADC and DAC. However, RRAM-based BNN hardware still requires high-resolution ADC for partial sum calculation to implement large-scale neural network using multiple memory arrays. We propose a neural network-hardware co-design approach to split input to fit each split network on a RRAM array so that the reconstructed BNNs calculate 1-bit output neuron in each array. As a result, ADC can be completely eliminated from the design even for large-scale neural network. Simulation results show that the proposed network reconstruction and retraining recovers the inference accuracy of the original BNN. The accuracy loss of the proposed scheme in the CIFAR-10 testcase was less than 1.1

READ FULL TEXT

page 3

page 6

research
03/30/2017

Deep Neural Network Optimized to Resistive Memory with Nonlinear Current-Voltage Characteristics

Artificial Neural Network computation relies on intensive vector-matrix ...
research
09/03/2021

On the Accuracy of Analog Neural Network Inference Accelerators

Specialized accelerators have recently garnered attention as a method to...
research
08/21/2018

Dominant Channel Estimation via MIPS for Large-Scale Antenna Systems with One-Bit ADCs

In large-scale antenna systems, using one-bit analog-to-digital converte...
research
03/23/2019

BitSplit-Net: Multi-bit Deep Neural Network with Bitwise Activation Function

Significant computational cost and memory requirements for deep neural n...
research
04/27/2020

LSHR-Net: a hardware-friendly solution for high-resolution computational imaging using a mixed-weights neural network

Recent work showed neural-network-based approaches to reconstructing ima...
research
02/07/2021

CrossStack: A 3-D Reconfigurable RRAM Crossbar Inference Engine

Deep neural network inference accelerators are rapidly growing in import...
research
01/28/2022

Testable Array Multipliers for a Better Utilization of C-Testability and Bijectivity

This paper presents a design for test (DFT)architecture for fast and sca...

Please sign up or login with your details

Forgot password? Click here to reset