Improved Robustness Against Adaptive Attacks With Ensembles and Error-Correcting Output Codes

03/04/2023
by   Thomas Philippon, et al.
0

Neural network ensembles have been studied extensively in the context of adversarial robustness and most ensemble-based approaches remain vulnerable to adaptive attacks. In this paper, we investigate the robustness of Error-Correcting Output Codes (ECOC) ensembles through architectural improvements and ensemble diversity promotion. We perform a comprehensive robustness assessment against adaptive attacks and investigate the relationship between ensemble diversity and robustness. Our results demonstrate the benefits of ECOC ensembles for adversarial robustness compared to regular ensembles of convolutional neural networks (CNNs) and show why the robustness of previous implementations is limited. We also propose an adversarial training method specific to ECOC ensembles that allows to further improve robustness to adaptive attacks.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
01/28/2019

Improving Adversarial Robustness of Ensembles with Diversity Training

Deep Neural Networks are vulnerable to adversarial attacks even in setti...
research
11/30/2019

Error-Correcting Neural Network

Error-correcting output codes (ECOC) is an ensemble method combining a s...
research
02/11/2022

Towards Adversarially Robust Deepfake Detection: An Ensemble Approach

Detecting deepfakes is an important problem, but recent work has shown t...
research
03/31/2022

Scalable Whitebox Attacks on Tree-based Models

Adversarial robustness is one of the essential safety criteria for guara...
research
09/07/2020

ECOC as a Method of Constructing Deep Convolutional Neural Network Ensembles

Deep neural networks have enhanced the performance of decision making sy...
research
09/30/2022

Learning Robust Kernel Ensembles with Kernel Average Pooling

Model ensembles have long been used in machine learning to reduce the va...
research
11/22/2018

Strength in Numbers: Trading-off Robustness and Computation via Adversarially-Trained Ensembles

While deep learning has led to remarkable results on a number of challen...

Please sign up or login with your details

Forgot password? Click here to reset