DeepAI AI Chat
Log In Sign Up

Evolving Neural Networks with Optimal Balance between Information Flow and Connections Cost

02/12/2022
by   Abdullah Khalili, et al.
0

Evolving Neural Networks (NNs) has recently seen an increasing interest as an alternative path that might be more successful. It has many advantages compared to other approaches, such as learning the architecture of the NNs. However, the extremely large search space and the existence of many complex interacting parts still represent a major obstacle. Many criteria were recently investigated to help guide the algorithm and to cut down the large search space. Recently there has been growing research bringing insights from network science to improve the design of NNs. In this paper, we investigate evolving NNs architectures that have one of the most fundamental characteristics of real-world networks, namely the optimal balance between connections cost and information flow. The performance of different metrics that represent this balance is evaluated and the improvement in the accuracy of putting more selection pressure toward this balance is demonstrated on three datasets.

READ FULL TEXT

page 1

page 2

page 3

page 4

11/22/2020

Evolving Search Space for Neural Architecture Search

The automation of neural architecture design has been a coveted alternat...
04/09/2021

Combined Depth Space based Architecture Search For Person Re-identification

Most works on person re-identification (ReID) take advantage of large ba...
01/30/2022

Neural Architecture Ranker

Architecture ranking has recently been advocated to design an efficient ...
12/07/2021

GraphPAS: Parallel Architecture Search for Graph Neural Networks

Graph neural architecture search has received a lot of attention as Grap...
02/27/2023

An algorithmic framework for the optimization of deep neural networks architectures and hyperparameters

In this paper, we propose an algorithmic framework to automatically gene...
05/11/2020

Feature Selection with Evolving, Fast and Slow Using Two Parallel Genetic Algorithms

Feature selection is one of the most challenging issues in machine learn...
06/03/2018

An Aggressive Genetic Programming Approach for Searching Neural Network Structure Under Computational Constraints

Recently, there emerged revived interests of designing automatic program...