A Systematic Approach to Blocking Convolutional Neural Networks

06/14/2016
by   Xuan Yang, et al.
0

Convolutional Neural Networks (CNNs) are the state of the art solution for many computer vision problems, and many researchers have explored optimized implementations. Most implementations heuristically block the computation to deal with the large data sizes and high data reuse of CNNs. This paper explores how to block CNN computations for memory locality by creating an analytical model for CNN-like loop nests. Using this model we automatically derive optimized blockings for common networks that improve the energy efficiency of custom hardware implementations by up to an order of magnitude. Compared to traditional CNN CPU implementations based on highly-tuned, hand-optimized BLAS libraries,our x86 programs implementing the optimal blocking reduce the number of memory accesses by up to 90

READ FULL TEXT

page 4

page 5

page 8

page 9

page 10

research
10/12/2016

Optimizing Memory Efficiency for Deep Convolutional Neural Networks on GPUs

Leveraging large data sets, deep Convolutional Neural Networks (CNNs) ac...
research
07/21/2022

COBRA: Cpu-Only aBdominal oRgan segmentAtion

Abdominal organ segmentation is a difficult and time-consuming task. To ...
research
06/22/2023

To Spike or Not to Spike? A Quantitative Comparison of SNN and CNN FPGA Implementations

Convolutional Neural Networks (CNNs) are widely employed to solve variou...
research
03/07/2018

HENet:A Highly Efficient Convolutional Neural Networks Optimized for Accuracy, Speed and Storage

In order to enhance the real-time performance of convolutional neural ne...
research
01/24/2021

Analytical Characterization and Design Space Exploration for Optimization of CNNs

Moving data through the memory hierarchy is a fundamental bottleneck tha...
research
05/09/2019

NeuPart: Using Analytical Models to Drive Energy-Efficient Partitioning of CNN Computations on Cloud-Connected Mobile Clients

Data processing on convolutional neural networks (CNNs) places a heavy b...
research
09/10/2018

DNN Dataflow Choice Is Overrated

Many DNN accelerators have been proposed and built using different micro...

Please sign up or login with your details

Forgot password? Click here to reset