AutoCoMet: Smart Neural Architecture Search via Co-Regulated Shaping Reinforcement

03/29/2022
by   Mayukh Das, et al.
4

Designing suitable deep model architectures, for AI-driven on-device apps and features, at par with rapidly evolving mobile hardware and increasingly complex target scenarios is a difficult task. Though Neural Architecture Search (NAS/AutoML) has made this easier by shifting paradigm from extensive manual effort to automated architecture learning from data, yet it has major limitations, leading to critical bottlenecks in the context of mobile devices, including model-hardware fidelity, prohibitive search times and deviation from primary target objective(s). Thus, we propose AutoCoMet that can learn the most suitable DNN architecture optimized for varied types of device hardware and task contexts,   3x faster. Our novel co-regulated shaping reinforcement controller together with the high fidelity hardware meta-behavior predictor produces a smart, fast NAS framework that adapts to context via a generalized formalism for any kind of multi-criteria optimization.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
12/31/2019

Modeling Neural Architecture Search Methods for Deep Networks

There are many research works on the designing of architectures for the ...
research
05/05/2023

Neural Architecture Search for Intel Movidius VPU

Hardware-aware Neural Architecture Search (NAS) technologies have been p...
research
02/23/2022

Towards Tailored Models on Private AIoT Devices: Federated Direct Neural Architecture Search

Neural networks often encounter various stringent resource constraints w...
research
02/15/2020

Neural Architecture Search over Decentralized Data

To preserve user privacy while enabling mobile intelligence, techniques ...
research
05/19/2022

A Hardware-Aware Framework for Accelerating Neural Architecture Search Across Modalities

Recent advances in Neural Architecture Search (NAS) such as one-shot NAS...
research
08/18/2020

Discovering Multi-Hardware Mobile Models via Architecture Search

Developing efficient models for mobile phones or other on-device deploym...
research
03/19/2023

ERSAM: Neural Architecture Search For Energy-Efficient and Real-Time Social Ambiance Measurement

Social ambiance describes the context in which social interactions happe...

Please sign up or login with your details

Forgot password? Click here to reset