ANTNets: Mobile Convolutional Neural Networks for Resource Efficient Image Classification

04/07/2019
by   Yunyang Xiong, et al.
0

Deep convolutional neural networks have achieved remarkable success in computer vision. However, deep neural networks require large computing resources to achieve high performance. Although depthwise separable convolution can be an efficient module to approximate a standard convolution, it often leads to reduced representational power of networks. In this paper, under budget constraints such as computational cost (MAdds) and the parameter count, we propose a novel basic architectural block, ANTBlock. It boosts the representational power by modeling, in a high dimensional space, interdependency of channels between a depthwise convolution layer and a projection layer in the ANTBlocks. Our experiments show that ANTNet built by a sequence of ANTBlocks, consistently outperforms state-of-the-art low-cost mobile convolutional neural networks across multiple datasets. On CIFAR100, our model achieves 75.7 8.3 achieves 72.8 faster) on iPhone 5s over MobileNetV2.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
01/09/2020

Compression of convolutional neural networks for high performance imagematching tasks on mobile devices

Deep neural networks have demonstrated state-of-the-art performance for ...
research
01/19/2018

EffNet: An Efficient Structure for Convolutional Neural Networks

With the ever increasing application of Convolutional Neural Networks to...
research
01/03/2021

Learning Neural Networks on SVD Boosted Latent Spaces for Semantic Classification

The availability of large amounts of data and compelling computation pow...
research
05/18/2021

Overparametrization of HyperNetworks at Fixed FLOP-Count Enables Fast Neural Image Enhancement

Deep convolutional neural networks can enhance images taken with small m...
research
11/30/2018

Projection Convolutional Neural Networks for 1-bit CNNs via Discrete Back Propagation

The advancement of deep convolutional neural networks (DCNNs) has driven...
research
06/19/2021

CompConv: A Compact Convolution Module for Efficient Feature Learning

Convolutional Neural Networks (CNNs) have achieved remarkable success in...
research
03/24/2018

Merging and Evolution: Improving Convolutional Neural Networks for Mobile Applications

Compact neural networks are inclined to exploit "sparsely-connected" con...

Please sign up or login with your details

Forgot password? Click here to reset