Benchmark Analysis of Representative Deep Neural Network Architectures

10/01/2018
by   Simone Bianco, et al.
0

This work presents an in-depth analysis of the majority of the deep neural networks (DNNs) proposed in the state of the art for image recognition. For each DNN multiple performance indices are observed, such as recognition accuracy, model complexity, computational complexity, memory usage, and inference time. The behavior of such performance indices and some combinations of them are analyzed and discussed. To measure the indices we experiment the use of DNNs on two different computer architectures, a workstation equipped with a NVIDIA Titan X Pascal and an embedded system based on a NVIDIA Jetson TX1 board. This experimentation allows a direct comparison between DNNs running on machines with very different computational capacity. This study is useful for researchers to have a complete view of what solutions have been explored so far and in which research directions are worth exploring in the future; and for practitioners to select the DNN architecture(s) that better fit the resource constraints of practical deployments and applications. To complete this work, all the DNNs, as well as the software used for the analysis, are available online.

READ FULL TEXT

page 5

page 6

page 8

research
07/11/2023

Number Systems for Deep Neural Network Architectures: A Survey

Deep neural networks (DNNs) have become an enabling component for a myri...
research
07/29/2022

Computational complexity reduction of deep neural networks

Deep neural networks (DNN) have been widely used and play a major role i...
research
12/24/2019

An Analysis of the Expressiveness of Deep Neural Network Architectures Based on Their Lipschitz Constants

Deep neural networks (DNNs) have emerged as a popular mathematical tool ...
research
04/09/2019

Automated Search for Configurations of Deep Neural Network Architectures

Deep Neural Networks (DNNs) are intensively used to solve a wide variety...
research
12/24/2019

Pruning Deep Neural Networks Architectures with Evolution Strategy

Currently, Deep Neural Networks (DNNs) are used to solve all kinds of pr...
research
03/25/2022

Concept Embedding Analysis: A Review

Deep neural networks (DNNs) have found their way into many applications ...
research
03/16/2018

TBD: Benchmarking and Analyzing Deep Neural Network Training

The recent popularity of deep neural networks (DNNs) has generated a lot...

Please sign up or login with your details

Forgot password? Click here to reset