Combining Neuro-Evolution of Augmenting Topologies with Convolutional Neural Networks

08/18/2021
by   Jan Nils Ferner, et al.
0

Current deep convolutional networks are fixed in their topology. We explore the possibilites of making the convolutional topology a parameter itself by combining NeuroEvolution of Augmenting Topologies (NEAT) with Convolutional Neural Networks (CNNs) and propose such a system using blocks of Residual Networks (ResNets). We then explain how our suggested system can only be built once additional optimizations have been made, as genetic algorithms are way more demanding than training per backpropagation. On the way there we explain most of those buzzwords and offer a gentle and brief introduction to the most important modern areas of machine learning.

READ FULL TEXT
research
04/23/2014

One weird trick for parallelizing convolutional neural networks

I present a new way to parallelize the training of convolutional neural ...
research
09/10/2018

Finding Better Topologies for Deep Convolutional Neural Networks by Evolution

Due to the nonlinearity of artificial neural networks, designing topolog...
research
03/15/2017

Large Scale Evolution of Convolutional Neural Networks Using Volunteer Computing

This work presents a new algorithm called evolutionary exploration of au...
research
11/29/2018

Deep learning for pedestrians: backpropagation in CNNs

The goal of this document is to provide a pedagogical introduction to th...
research
02/10/2021

Two Novel Performance Improvements for Evolving CNN Topologies

Convolutional Neural Networks (CNNs) are the state-of-the-art algorithms...
research
11/17/2018

Accelerating the Evolution of Convolutional Neural Networks with Node-Level Mutations and Epigenetic Weight Initialization

This paper examines three generic strategies for improving the performan...
research
05/13/2022

Modularity in NEAT Reinforcement Learning Networks

Modularity is essential to many well-performing structured systems, as i...

Please sign up or login with your details

Forgot password? Click here to reset