Convolution with Logarithmic Filter Groups for Efficient Shallow CNN

07/31/2017
by   Tae Kwan Lee, et al.
0

In convolutional neural networks (CNNs), the filter grouping in convolution layers is known to be useful to reduce the network parameter size. In this paper, we propose a new logarithmic filter grouping which can capture the nonlinearity of filter distribution in CNNs. The proposed logarithmic filter grouping is installed in shallow CNNs applicable in a mobile application. Experiments were performed with the shallow CNNs for classification tasks. Our classification results on Multi-PIE dataset for facial expression recognition and CIFAR-10 dataset for object classification reveal that the compact CNN with the proposed logarithmic filter grouping scheme outperforms the same network with the uniform filter grouping in terms of accuracy and parameter efficiency. Our results indicate that the efficiency of shallow CNNs can be improved by the proposed logarithmic filter grouping.

READ FULL TEXT
research
07/26/2017

Optimizing Filter Size in Convolutional Neural Networks for Facial Action Unit Recognition

Recognizing facial action units (AUs) during spontaneous facial displays...
research
08/26/2019

Stochastic Filter Groups for Multi-Task CNNs: Learning Specialist and Generalist Convolution Kernels

The performance of multi-task learning in Convolutional Neural Networks ...
research
03/22/2016

Convolution in Convolution for Network in Network

Network in Netwrok (NiN) is an effective instance and an important exten...
research
11/27/2017

Transfer Learning in CNNs Using Filter-Trees

Convolutional Neural Networks (CNNs) are very effective for many pattern...
research
11/28/2018

WaveletNet: Logarithmic Scale Efficient Convolutional Neural Networks for Edge Devices

We present a logarithmic-scale efficient convolutional neural network ar...
research
04/20/2016

Deep CNNs for HEp-2 Cells Classification : A Cross-specimen Analysis

Automatic classification of Human Epithelial Type-2 (HEp-2) cells staini...
research
05/25/2021

FILTRA: Rethinking Steerable CNN by Filter Transform

Steerable CNN imposes the prior knowledge of transformation invariance o...

Please sign up or login with your details

Forgot password? Click here to reset