Enhancing sensor resolution improves CNN accuracy given the same number of parameters or FLOPS

03/09/2021
by   Ali Borji, et al.
0

High image resolution is critical to obtain a good performance in many computer vision applications. Computational complexity of CNNs, however, grows significantly with the increase in input image size. Here, we show that it is almost always possible to modify a network such that it achieves higher accuracy at a higher input resolution while having the same number of parameters or/and FLOPS. The idea is similar to the EfficientNet paper but instead of optimizing network width, depth and resolution simultaneously, here we focus only on input resolution. This makes the search space much smaller which is more suitable for low computational budget regimes. More importantly, by controlling for the number of model parameters (and hence model capacity), we show that the additional benefit in accuracy is indeed due to the higher input resolution. Preliminary empirical investigation over MNIST, Fashion MNIST, and CIFAR10 datasets demonstrates the efficiency of the proposed approach.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/10/2021

Group Equivariant Neural Architecture Search via Group Decomposition and Reinforcement Learning

Recent works show that including group equivariance as an inductive bias...
research
10/27/2020

Are wider nets better given the same number of parameters?

Empirical studies demonstrate that the performance of neural networks im...
research
05/12/2023

T-former: An Efficient Transformer for Image Inpainting

Benefiting from powerful convolutional neural networks (CNNs), learning-...
research
06/05/2021

Dynamic Resolution Network

Deep convolutional neural networks (CNNs) are often of sophisticated des...
research
06/05/2020

Incorporating Image Gradients as Secondary Input Associated with Input Image to Improve the Performance of the CNN Model

CNN is very popular neural network architecture in modern days. It is pr...
research
12/23/2022

Capacity Studies for a Differential Growing Neural Gas

In 2019 Kerdels and Peters proposed a grid cell model (GCM) based on a D...
research
09/07/2019

Non-discriminative data or weak model? On the relative importance of data and model resolution

We explore the question of how the resolution of the input image ("input...

Please sign up or login with your details

Forgot password? Click here to reset