Autonomous Deep Learning: A Genetic DCNN Designer for Image Classification

07/01/2018
by   Benteng Ma, et al.
0

Recent years have witnessed the breakthrough success of deep convolutional neural networks (DCNNs) in image classification and other vision applications. Although freeing users from the troublesome handcrafted feature extraction by providing a uniform feature extraction-classification framework, DCNNs still require a handcrafted design of their architectures. In this paper, we propose the genetic DCNN designer, an autonomous learning algorithm can generate a DCNN architecture automatically based on the data available for a specific image classification problem. We first partition a DCNN into multiple stacked meta convolutional blocks and fully connected blocks, each containing the operations of convolution, pooling, fully connection, batch normalization, activation and drop out, and thus convert the architecture into an integer vector. Then, we use refined evolutionary operations, including selection, mutation and crossover to evolve a population of DCNN architectures. Our results on the MNIST, Fashion-MNIST, EMNISTDigit, EMNIST-Letter, CIFAR10 and CIFAR100 datasets suggest that the proposed genetic DCNN designer is able to produce automatically DCNN architectures, whose performance is comparable to, if not better than, that of stateof- the-art DCNN models

READ FULL TEXT

page 4

page 6

research
06/24/2022

Evolution of Activation Functions for Deep Learning-Based Image Classification

Activation functions (AFs) play a pivotal role in the performance of neu...
research
04/03/2017

A Genetic Programming Approach to Designing Convolutional Neural Network Architectures

The convolutional neural network (CNN), which is one of the deep learnin...
research
01/23/2017

Residual and Plain Convolutional Neural Networks for 3D Brain MRI Classification

In the recent years there have been a number of studies that applied dee...
research
10/03/2022

Feature Embedding by Template Matching as a ResNet Block

Convolution blocks serve as local feature extractors and are the key to ...
research
03/18/2018

Neural Architecture Construction using EnvelopeNets

In recent years, advances in the design of convolutional neural networks...
research
10/30/2017

Evolving Deep Convolutional Neural Networks for Image Classification

Evolutionary computation methods have been successfully applied to neura...
research
07/27/2020

Towards Learning Convolutions from Scratch

Convolution is one of the most essential components of architectures use...

Please sign up or login with your details

Forgot password? Click here to reset