DeepAI AI Chat
Log In Sign Up

Efficient Neural Architecture Search with Performance Prediction

by   Ibrahim Alshubaily, et al.

Neural networks are powerful models that have a remarkable ability to extract patterns that are too complex to be noticed by humans or other machine learning models. Neural networks are the first class of models that can train end-to-end systems with large learning capacities. However, we still have the difficult challenge of designing the neural network, which requires human experience and a long process of trial and error. As a solution, we can use a neural architecture search to find the best network architecture for the task at hand. Existing NAS algorithms generally evaluate the fitness of a new architecture by fully training from scratch, resulting in the prohibitive computational cost, even if operated on high-performance computers. In this paper, an end-to-end offline performance predictor is proposed to accelerate the evaluation of sampled architectures. Index Terms- Learning Curve Prediction, Neural Architecture Search, Reinforcement Learning.


page 1

page 2

page 3

page 4


Stochastic Adaptive Neural Architecture Search for Keyword Spotting

The problem of keyword spotting i.e. identifying keywords in a real-time...

Neural Architecture Search For Fault Diagnosis

Data-driven methods have made great progress in fault diagnosis, especia...

An Efficient End-to-End 3D Model Reconstruction based on Neural Architecture Search

Using neural networks to represent 3D objects has become popular. Howeve...

TAPAS: Train-less Accuracy Predictor for Architecture Search

In recent years an increasing number of researchers and practitioners ha...

Canvas: End-to-End Kernel Architecture Search in Neural Networks

The demands for higher performance and accuracy in neural networks (NNs)...

Balancing Accuracy and Latency in Multipath Neural Networks

The growing capacity of neural networks has strongly contributed to thei...