EPNAS: Efficient Progressive Neural Architecture Search

07/07/2019
by   Yanqi Zhou, et al.
0

In this paper, we propose Efficient Progressive Neural Architecture Search (EPNAS), a neural architecture search (NAS) that efficiently handles large search space through a novel progressive search policy with performance prediction based on REINFORCE Williams.1992.PG. EPNAS is designed to search target networks in parallel, which is more scalable on parallel systems such as GPU/TPU clusters. More importantly, EPNAS can be generalized to architecture search with multiple resource constraints, , model size, compute complexity or intensity, which is crucial for deployment in widespread platforms such as mobile and cloud. We compare EPNAS against other state-of-the-art (SoTA) network architectures (, MobileNetV2 mobilenetv2) and efficient NAS algorithms (, ENAS pham2018efficient, and PNAS Liu2017b) on image recognition tasks using CIFAR10 and ImageNet. On both datasets, EPNAS is superior architecture searching speed and recognition accuracy.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/27/2020

Neural Architecture Search of SPD Manifold Networks

In this paper, we propose a new neural architecture search (NAS) problem...
research
03/11/2020

PONAS: Progressive One-shot Neural Architecture Search for Very Efficient Deployment

We achieve very efficient deep learning model deployment that designs ne...
research
11/19/2019

Hybrid Composition with IdleBlock: More Efficient Networks for Image Recognition

We propose a new building block, IdleBlock, which naturally prunes conne...
research
05/29/2020

HourNAS: Extremely Fast Neural Architecture Search Through an Hourglass Lens

Neural Architecture Search (NAS) refers to automatically design the arch...
research
05/17/2019

DeepSwarm: Optimising Convolutional Neural Networks using Swarm Intelligence

In this paper we propose DeepSwarm, a novel neural architecture search (...
research
03/09/2019

Partial Order Pruning: for Best Speed/Accuracy Trade-off in Neural Architecture Search

Achieving good speed and accuracy trade-off on target platform is very i...
research
03/25/2021

EfficientTDNN: Efficient Architecture Search for Speaker Recognition in the Wild

Speaker recognition refers to audio biometrics that utilizes acoustic ch...

Please sign up or login with your details

Forgot password? Click here to reset