Inner-Imaging Convolutional Networks

04/22/2019
by   Yang Hu, et al.
0

Despite the tremendous success in computer vision, deep convolutional networks suffer from serious computation cost and redundancies. Although previous works address this issue by enhancing diversities of filters, they ignore that both complementarity and completeness are required in the internal structure of convolutional network. In this setting, we propose a novel Inner-Imaging architecture, which allows relationships between channels to meet the above requirement. Specifically, we organize the filter signal points in groups using convolutional kernels to model both the intra- and inter-group relationships simultaneously. Consequently, we not only increase diversities of channels but also explicitly enhance the complementarity and completeness. Our proposed architecture is lightweight and easy to be implemented for improving the modelling efficiency and performance. We conduct extensive experiments on CIFAR, SVHN and ImageNet and verify the effectiveness of our inner-imaging architecture with residual networks as the backbone.

READ FULL TEXT
research
10/24/2019

Circulant Binary Convolutional Networks: Enhancing the Performance of 1-bit DCNNs with Circulant Back Propagation

The rapidly decreasing computation and memory cost has recently driven t...
research
11/27/2018

GaterNet: Dynamic Filter Selection in Convolutional Neural Network via a Dedicated Global Gating Network

The concept of conditional computation for deep nets has been proposed p...
research
07/24/2018

Competitive Inner-Imaging Squeeze and Excitation for Residual Network

Residual Network make the very deep convolutional architecture works wel...
research
12/11/2019

Robust Gabor Networks

This work takes a step towards investigating the benefits of merging cla...
research
06/05/2018

Deep Mixture of Experts via Shallow Embedding

Larger networks generally have greater representational power at the cos...
research
06/23/2016

Automatic Neuron Detection in Calcium Imaging Data Using Convolutional Networks

Calcium imaging is an important technique for monitoring the activity of...

Please sign up or login with your details

Forgot password? Click here to reset