Bi-fidelity Evolutionary Multiobjective Search for Adversarially Robust Deep Neural Architectures

07/12/2022
by   Jia Liu, et al.
0

Deep neural networks have been found vulnerable to adversarial attacks, thus raising potentially concerns in security-sensitive contexts. To address this problem, recent research has investigated the adversarial robustness of deep neural networks from the architectural point of view. However, searching for architectures of deep neural networks is computationally expensive, particularly when coupled with adversarial training process. To meet the above challenge, this paper proposes a bi-fidelity multiobjective neural architecture search approach. First, we formulate the NAS problem for enhancing adversarial robustness of deep neural networks into a multiobjective optimization problem. Specifically, in addition to a low-fidelity performance predictor as the first objective, we leverage an auxiliary-objective – the value of which is the output of a surrogate model trained with high-fidelity evaluations. Secondly, we reduce the computational cost by combining three performance estimation methods, i.e., parameter sharing, low-fidelity evaluation, and surrogate-based predictor. The effectiveness of the proposed approach is confirmed by extensive experiments conducted on CIFAR-10, CIFAR-100 and SVHN datasets.

READ FULL TEXT

page 1

page 4

page 5

research
05/12/2023

Efficient Search of Comprehensively Robust Neural Architectures via Multi-fidelity Evaluation

Neural architecture search (NAS) has emerged as one successful technique...
research
04/27/2022

PRE-NAS: Predictor-assisted Evolutionary Neural Architecture Search

Neural architecture search (NAS) aims to automate architecture engineeri...
research
11/25/2019

When NAS Meets Robustness: In Search of Robust Architectures against Adversarial Attacks

Recent advances in adversarial attacks uncover the intrinsic vulnerabili...
research
06/12/2023

Differentiable Multi-Fidelity Fusion: Efficient Learning of Physics Simulations with Neural Architecture Search and Transfer Learning

With rapid progress in deep learning, neural networks have been widely u...
research
06/11/2023

Neural Architecture Design and Robustness: A Dataset

Deep learning models have proven to be successful in a wide range of mac...
research
12/11/2020

DSRNA: Differentiable Search of Robust Neural Architectures

In deep learning applications, the architectures of deep neural networks...
research
10/25/2022

An adaptive multi-fidelity framework for safety analysis of connected and automated vehicles

Testing and evaluation are expensive but critical steps in the developme...

Please sign up or login with your details

Forgot password? Click here to reset