Data-Side Efficiencies for Lightweight Convolutional Neural Networks

08/24/2023
by   Bryan Bo Cao, et al.
0

We examine how the choice of data-side attributes for two important visual tasks of image classification and object detection can aid in the choice or design of lightweight convolutional neural networks. We show by experimentation how four data attributes - number of classes, object color, image resolution, and object scale affect neural network model size and efficiency. Intra- and inter-class similarity metrics, based on metric learning, are defined to guide the evaluation of these attributes toward achieving lightweight models. Evaluations made using these metrics are shown to require 30x less computation than running full inference tests. We provide, as an example, applying the metrics and methods to choose a lightweight model for a robot path planning application and achieve computation reduction of 66 over the pre-method model.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
07/05/2017

Towards lightweight convolutional neural networks for object detection

We propose model with larger spatial size of feature maps and evaluate i...
research
06/24/2014

Recurrent Models of Visual Attention

Applying convolutional neural networks to large images is computationall...
research
02/15/2022

DualConv: Dual Convolutional Kernels for Lightweight Deep Neural Networks

CNN architectures are generally heavy on memory and computational requir...
research
11/12/2020

Gaussian RAM: Lightweight Image Classification via Stochastic Retina-Inspired Glimpse and Reinforcement Learning

Previous studies on image classification have mainly focused on the perf...
research
05/05/2017

Residual Squeeze VGG16

Deep learning has given way to a new era of machine learning, apart from...
research
05/29/2020

Applying the Decisiveness and Robustness Metrics to Convolutional Neural Networks

We review three recently-proposed classifier quality metrics and conside...
research
10/28/2021

Characterizing and Taming Resolution in Convolutional Neural Networks

Image resolution has a significant effect on the accuracy and computatio...

Please sign up or login with your details

Forgot password? Click here to reset