clcNet: Improving the Efficiency of Convolutional Neural Network using Channel Local Convolutions

12/17/2017
by   Dong-Qing Zhang, et al.
0

Depthwise convolution and grouped convolution has been successfully applied to improve the efficiency of convolutional neural network (CNN). This paper generalizes these convolution models to a general type of convolution named channel local convolution (CLC), where an output channel of convolution only depends on a subset of its input channels. This concept extends the spatial locality property of convolution to the channel dimension, thereby offering new dimension for network design. A CLC kernel is characterized by its channel dependency graph (CDG), the graphical representation of the dependencies between the input and output channels. CDG can be utilized to facilitate the design of the convolution block created by stacking multiple CLC kernels. We present an example of such design named CLC block, a novel structure distinct from previous models with fewer parameters and less computational cost. Based upon the CLC blocks, a new convolutional neural network named clcNet is constructed. And the experiments on Imagenet-1K dataset show that the clcNet achieves significantly higher computational efficiency and fewer parameters compared to the state-of-the-art networks.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
11/28/2018

WaveletNet: Logarithmic Scale Efficient Convolutional Neural Networks for Edge Devices

We present a logarithmic-scale efficient convolutional neural network ar...
research
10/01/2019

NESTA: Hamming Weight Compression-Based Neural Proc. Engine

In this paper, we present NESTA, a specialized Neural engine that signif...
research
11/24/2020

MicroNet: Towards Image Recognition with Extremely Low FLOPs

In this paper, we present MicroNet, which is an efficient convolutional ...
research
03/27/2020

Dynamic Region-Aware Convolution

We propose a new convolution called Dynamic Region-Aware Convolution (DR...
research
06/26/2023

Optimized Vectorizing of Building Structures with Swap: High-Efficiency Convolutional Channel-Swap Hybridization Strategy

The building planar graph reconstruction, a.k.a. footprint reconstructio...
research
01/06/2019

Channel Locality Block: A Variant of Squeeze-and-Excitation

Attention mechanism is a hot spot in deep learning field. Using channel ...
research
03/22/2016

Convolution in Convolution for Network in Network

Network in Netwrok (NiN) is an effective instance and an important exten...

Please sign up or login with your details

Forgot password? Click here to reset