Condensation-Net: Memory-Efficient Network Architecture with Cross-Channel Pooling Layers and Virtual Feature Maps

04/29/2021
by   Tse-Wei Chen, et al.
0

"Lightweight convolutional neural networks" is an important research topic in the field of embedded vision. To implement image recognition tasks on a resource-limited hardware platform, it is necessary to reduce the memory size and the computational cost. The contribution of this paper is stated as follows. First, we propose an algorithm to process a specific network architecture (Condensation-Net) without increasing the maximum memory storage for feature maps. The architecture for virtual feature maps saves 26.5 memory bandwidth by calculating the results of cross-channel pooling before storing the feature map into the memory. Second, we show that cross-channel pooling can improve the accuracy of object detection tasks, such as face detection, because it increases the number of filter weights. Compared with Tiny-YOLOv2, the improvement of accuracy is 2.0 1.5 not the least, the analysis results show that the overhead to support the cross-channel pooling with the proposed hardware architecture is negligible small. The extra memory cost to support Condensation-Net is 0.2 size, and the extra gate count is only 1.0

READ FULL TEXT

page 1

page 2

page 3

page 4

research
01/09/2022

ThreshNet: An Efficient DenseNet using Threshold Mechanism to Reduce Connections

With the continuous development of neural networks in computer vision ta...
research
09/16/2020

Pooling Methods in Deep Neural Networks, a Review

Nowadays, Deep Neural Networks are among the main tools used in various ...
research
07/06/2019

Multi-level Wavelet Convolutional Neural Networks

In computer vision, convolutional networks (CNNs) often adopts pooling t...
research
03/26/2019

SRM : A Style-based Recalibration Module for Convolutional Neural Networks

Following the advance of style transfer with Convolutional Neural Networ...
research
04/10/2019

Drop an Octave: Reducing Spatial Redundancy in Convolutional Neural Networks with Octave Convolution

In natural images, information is conveyed at different frequencies wher...
research
06/19/2018

Automatic segmentation of prostate zones

Convolutional networks have become state-of-the-art techniques for autom...
research
08/15/2018

DNN Feature Map Compression using Learned Representation over GF(2)

In this paper, we introduce a method to compress intermediate feature ma...

Please sign up or login with your details

Forgot password? Click here to reset