A Novel Evolutionary Algorithm for Hierarchical Neural Architecture Search

In this work, we propose a novel evolutionary algorithm for neural architecture search, applicable to global search spaces. The algorithm's architectural representation organizes the topology in multiple hierarchical modules, while the design process exploits this representation, in order to explore the search space. We also employ a curation system, which promotes the utilization of well performing sub-structures to subsequent generations. We apply our method to Fashion-MNIST and NAS-Bench101, achieving accuracies of 93.2% and 94.8% respectively in a relatively small number of generations.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
11/01/2017

Hierarchical Representations for Efficient Architecture Search

We explore efficient neural architecture search methods and present a si...
research
07/06/2023

LISSNAS: Locality-based Iterative Search Space Shrinkage for Neural Architecture Search

Search spaces hallmark the advancement of Neural Architecture Search (NA...
research
07/20/2021

LENS: Layer Distribution Enabled Neural Architecture Search in Edge-Cloud Hierarchies

Edge-Cloud hierarchical systems employing intelligence through Deep Neur...
research
02/06/2020

Variational Depth Search in ResNets

One-shot neural architecture search allows joint learning of weights and...
research
05/17/2019

DeepSwarm: Optimising Convolutional Neural Networks using Swarm Intelligence

In this paper we propose DeepSwarm, a novel neural architecture search (...
research
04/10/2021

Group Equivariant Neural Architecture Search via Group Decomposition and Reinforcement Learning

Recent works show that including group equivariance as an inductive bias...
research
05/11/2023

Backpropagation-Free 4D Continuous Ant-Based Neural Topology Search

Continuous Ant-based Topology Search (CANTS) is a previously introduced ...

Please sign up or login with your details

Forgot password? Click here to reset