DeepAI AI Chat
Log In Sign Up

Neural Architecture Search based on Cartesian Genetic Programming Coding Method

03/12/2021
by   Xuan Wu, et al.
0

Neural architecture search (NAS) is a hot topic in the field of automated machine learning (AutoML) and has begun to outperform human-designed architectures on many machine learning tasks. Motivated by the natural representation form of neural networks by the Cartesian genetic programming (CGP), we propose an evolutionary approach of NAS based on CGP, called CPGNAS, to solve sentence classification task. To evolve the architectures under the framework of CGP, the existing key operations are identified as the types of function nodes of CGP, and the evolutionary operations are designed based on evolutionary strategy (ES). The experimental results show that the searched architecture can reach the accuracy of human-designed architectures. The ablation tests identify the Attention function as the single key function node and the Convolution and Attention as the joint key function nodes. However, the linear transformations along could keep the accuracy of evolved architectures over 70

READ FULL TEXT

page 1

page 2

page 3

page 4

02/28/2023

EvoPrompting: Language Models for Code-Level Neural Architecture Search

Given the recent impressive accomplishments of language models (LMs) for...
08/23/2022

Evolutionary Quantum Architecture Search for Parametrized Quantum Circuits

Recent advancements in quantum computing have shown promising computatio...
05/27/2020

Evolutionary NAS with Gene Expression Programming of Cellular Encoding

The renaissance of neural architecture search (NAS) has seen classical m...
01/15/2023

EvoAAA: An evolutionary methodology for automated autoencoder architecture search

Machine learning models work better when curated features are provided t...
06/03/2020

FBNetV3: Joint Architecture-Recipe Search using Neural Acquisition Function

Neural Architecture Search (NAS) yields state-of-the-art neural networks...
06/29/2020

Towards Automated Neural Interaction Discovery for Click-Through Rate Prediction

Click-Through Rate (CTR) prediction is one of the most important machine...