Progressive Neural Networks for Image Classification

04/25/2018
by   Zhi Zhang, et al.
0

The inference structures and computational complexity of existing deep neural networks, once trained, are fixed and remain the same for all test images. However, in practice, it is highly desirable to establish a progressive structure for deep neural networks which is able to adapt its inference process and complexity for images with different visual recognition complexity. In this work, we develop a multi-stage progressive structure with integrated confidence analysis and decision policy learning for deep neural networks. This new framework consists of a set of network units to be activated in a sequential manner with progressively increased complexity and visual recognition power. Our extensive experimental results on the CIFAR-10 and ImageNet datasets demonstrate that the proposed progressive deep neural network is able to obtain more than 10 fold complexity scalability while achieving the state-of-the-art performance using a single network model satisfying different complexity-accuracy requirements.

READ FULL TEXT

page 2

page 3

research
01/26/2019

Progressive Label Distillation: Learning Input-Efficient Deep Neural Networks

Much of the focus in the area of knowledge distillation has been on dist...
research
01/20/2022

What can we learn from misclassified ImageNet images?

Understanding the patterns of misclassified ImageNet images is particula...
research
05/03/2018

Local Critic Training for Model-Parallel Learning of Deep Neural Networks

This paper proposes a novel approach to train deep neural networks in a ...
research
03/04/2021

Structure-Preserving Progressive Low-rank Image Completion for Defending Adversarial Attacks

Deep neural networks recognize objects by analyzing local image details ...
research
09/30/2020

AttendNets: Tiny Deep Image Recognition Neural Networks for the Edge via Visual Attention Condensers

While significant advances in deep learning has resulted in state-of-the...
research
07/18/2019

A feasibility study of deep neural networks for the recognition of banknotes regarding central bank requirements

This paper contains a feasibility study of deep neural networks for the ...
research
10/12/2017

Can the early human visual system compete with Deep Neural Networks?

We study and compare the human visual system and state-of-the-art deep n...

Please sign up or login with your details

Forgot password? Click here to reset