Is it conceivable that neurogenesis, neural Darwinism, and species evolution could all serve as inspiration for the creation of evolutionary deep neural networks?

04/06/2023
by   Mohammed Al-Rawi, et al.
2

Deep Neural Networks (DNNs) are built using artificial neural networks. They are part of machine learning methods that are capable of learning from data that have been used in a wide range of applications. DNNs are mainly handcrafted and they usually contain numerous layers. Research frontier has emerged that concerns automated construction of DNNs via evolutionary algorithms. This paper emphasizes the importance of what we call two-dimensional brain evolution and how it can inspire two dimensional DNN evolutionary modeling. We also highlight the connection between the dropout method which is widely-used in regularizing DNNs and neurogenesis of the brain, and how these concepts could benefit DNNs evolution.The paper concludes with several recommendations for enhancing the automatic construction of DNNs.

READ FULL TEXT

page 5

page 6

research
02/16/2021

Neuroevolution in Deep Learning: The Role of Neutrality

A variety of methods have been applied to the architectural configuratio...
research
03/30/2022

ConceptEvo: Interpreting Concept Evolution in Deep Learning Training

Deep neural networks (DNNs) have been widely used for decision making, p...
research
01/02/2019

Evolutionary Construction of Convolutional Neural Networks

Neuro-Evolution is a field of study that has recently gained significant...
research
04/01/2021

Novel DNNs for Stiff ODEs with Applications to Chemically Reacting Flows

Chemically reacting flows are common in engineering, such as hypersonic ...
research
10/11/2021

Towards Explainable Real Estate Valuation via Evolutionary Algorithms

Human lives are increasingly influenced by algorithms, which therefore n...
research
06/09/2020

Neuroevolution in Deep Neural Networks: Current Trends and Future Challenges

A variety of methods have been applied to the architectural configuratio...
research
07/13/2019

Evolvability ES: Scalable and Direct Optimization of Evolvability

Designing evolutionary algorithms capable of uncovering highly evolvable...

Please sign up or login with your details

Forgot password? Click here to reset