Two Novel Performance Improvements for Evolving CNN Topologies

02/10/2021
by   Yaron Strauch, et al.
0

Convolutional Neural Networks (CNNs) are the state-of-the-art algorithms for the processing of images. However the configuration and training of these networks is a complex task requiring deep domain knowledge, experience and much trial and error. Using genetic algorithms, competitive CNN topologies for image recognition can be produced for any specific purpose, however in previous work this has come at high computational cost. In this work two novel approaches are presented to the utilisation of these algorithms, effective in reducing complexity and training time by nearly 20 regularisation directly on training time, and the use of partial training to enable early ranking of individual architectures. Both approaches are validated on the benchmark CIFAR10 data set, and maintain accuracy.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/12/2016

Fast Training of Convolutional Neural Networks via Kernel Rescaling

Training deep Convolutional Neural Networks (CNN) is a time consuming ta...
research
10/28/2018

Automatically Evolving CNN Architectures Based on Blocks

The performance of Convolutional Neural Networks (CNNs) highly relies on...
research
08/18/2021

Combining Neuro-Evolution of Augmenting Topologies with Convolutional Neural Networks

Current deep convolutional networks are fixed in their topology. We exp...
research
03/30/2018

Hierarchical Transfer Convolutional Neural Networks for Image Classification

In this paper, we address the issue of how to enhance the generalization...
research
07/07/2020

Enabling On-Device CNN Training by Self-Supervised Instance Filtering and Error Map Pruning

This work aims to enable on-device training of convolutional neural netw...
research
03/01/2021

Class Means as an Early Exit Decision Mechanism

State-of-the-art neural networks with early exit mechanisms often need c...
research
05/14/2021

Evolving Deep Convolutional Neural Network by Hybrid Sine-Cosine and Extreme Learning Machine for Real-time COVID19 Diagnosis from X-Ray Images

The COVID19 pandemic globally and significantly has affected the life an...

Please sign up or login with your details

Forgot password? Click here to reset