Convolutional Neural Networks at Constrained Time Cost

12/04/2014
by   Kaiming He, et al.
0

Though recent advanced convolutional neural networks (CNNs) have been improving the image recognition accuracy, the models are getting more complex and time-consuming. For real-world applications in industrial and commercial scenarios, engineers and developers are often faced with the requirement of constrained time budget. In this paper, we investigate the accuracy of CNNs under constrained time cost. Under this constraint, the designs of the network architectures should exhibit as trade-offs among the factors like depth, numbers of filters, filter sizes, etc. With a series of controlled comparisons, we progressively modify a baseline model while preserving its time complexity. This is also helpful for understanding the importance of the factors in network designs. We present an architecture that achieves very competitive accuracy in the ImageNet dataset (11.8 "AlexNet" (16.0

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/18/2020

Computational optimization of convolutional neural networks using separated filters architecture

This paper considers a convolutional neural network transformation that ...
research
08/19/2019

Adaptative Inference Cost With Convolutional Neural Mixture Models

Despite the outstanding performance of convolutional neural networks (CN...
research
04/18/2023

SO(2) and O(2) Equivariance in Image Recognition with Bessel-Convolutional Neural Networks

For many years, it has been shown how much exploiting equivariances can ...
research
09/19/2018

Characterising Across-Stack Optimisations for Deep Convolutional Neural Networks

Convolutional Neural Networks (CNNs) are extremely computationally deman...
research
09/30/2015

Fast Algorithms for Convolutional Neural Networks

Deep convolutional neural networks take GPU days of compute time to trai...
research
11/18/2019

ISP4ML: Understanding the Role of Image Signal Processing in Efficient Deep Learning Vision Systems

Convolutional neural networks (CNNs) are now predominant components in a...
research
05/10/2021

AFINet: Attentive Feature Integration Networks for Image Classification

Convolutional Neural Networks (CNNs) have achieved tremendous success in...

Please sign up or login with your details

Forgot password? Click here to reset