HADAS: Hardware-Aware Dynamic Neural Architecture Search for Edge Performance Scaling

12/06/2022
by   Halima Bouzidi, et al.
0

Dynamic neural networks (DyNNs) have become viable techniques to enable intelligence on resource-constrained edge devices while maintaining computational efficiency. In many cases, the implementation of DyNNs can be sub-optimal due to its underlying backbone architecture being developed at the design stage independent of both: (i) the dynamic computing features, e.g. early exiting, and (ii) the resource efficiency features of the underlying hardware, e.g., dynamic voltage and frequency scaling (DVFS). Addressing this, we present HADAS, a novel Hardware-Aware Dynamic Neural Architecture Search framework that realizes DyNN architectures whose backbone, early exiting features, and DVFS settings have been jointly optimized to maximize performance and resource efficiency. Our experiments using the CIFAR-100 dataset and a diverse set of edge computing platforms have seen HADAS dynamic models achieve up to 57 while maintaining the desired level of accuracy scores. Our code is available at https://github.com/HalimaBouzidi/HADAS

READ FULL TEXT

page 1

page 6

research
03/11/2021

HSCoNAS: Hardware-Software Co-Design of Efficient DNNs via Neural Architecture Search

In this paper, we present a novel multi-objective hardware-aware neural ...
research
01/09/2020

Performance-Oriented Neural Architecture Search

Hardware-Software Co-Design is a highly successful strategy for improvin...
research
03/05/2020

Accelerator-aware Neural Network Design using AutoML

While neural network hardware accelerators provide a substantial amount ...
research
03/30/2023

XPert: Peripheral Circuit Neural Architecture Co-search for Area and Energy-efficient Xbar-based Computing

The hardware-efficiency and accuracy of Deep Neural Networks (DNNs) impl...
research
06/06/2020

Conditional Neural Architecture Search

Designing resource-efficient Deep Neural Networks (DNNs) is critical to ...
research
02/23/2022

The Larger The Fairer? Small Neural Networks Can Achieve Fairness for Edge Devices

Along with the progress of AI democratization, neural networks are being...
research
04/06/2023

Hardware-Aware Static Optimization of Hyperdimensional Computations

Binary spatter code (BSC)-based hyperdimensional computing (HDC) is a hi...

Please sign up or login with your details

Forgot password? Click here to reset