Investigating the Corruption Robustness of Image Classifiers with Random Lp-norm Corruptions

05/09/2023
by   Georg Siedel, et al.
0

Robustness is a fundamental property of machine learning classifiers to achieve safety and reliability. In the fields of adversarial robustness and formal robustness verification of image classification models, robustness is commonly defined as the stability to all input variations within an Lp-norm distance. However, robustness to random corruptions is usually improved and evaluated using variations observed in the real-world, while mathematically defined Lp-norm corruptions are rarely considered. This study investigates the use of random Lp-norm corruptions to augment the training and test data of image classifiers. We adapt an approach from the field of adversarial robustness to assess the model robustness to imperceptible random corruptions. We empirically and theoretically investigate whether robustness is transferable across different Lp-norms and derive conclusions on which Lp-norm corruptions a model should be trained and evaluated on. We find that training data augmentation with L0-norm corruptions improves corruption robustness while maintaining accuracy compared to standard training and when applied on top of selected state-of-the-art data augmentation techniques.

READ FULL TEXT

page 4

page 6

research
03/02/2021

DeepCert: Verification of Contextually Relevant Robustness for Neural Network Image Classifiers

We introduce DeepCert, a tool-supported method for verifying the robustn...
research
06/20/2022

Revisiting lp-constrained Softmax Loss: A Comprehensive Study

Normalization is a vital process for any machine learning task as it con...
research
08/16/2021

IADA: Iterative Adversarial Data Augmentation Using Formal Verification and Expert Guidance

Neural networks (NNs) are widely used for classification tasks for their...
research
03/16/2022

Provable Adversarial Robustness for Fractional Lp Threat Models

In recent years, researchers have extensively studied adversarial robust...
research
06/03/2019

Achieving Generalizable Robustness of Deep Neural Networks by Stability Training

We study the recently introduced stability training as a general-purpose...
research
12/09/2021

PixMix: Dreamlike Pictures Comprehensively Improve Safety Measures

In real-world applications of machine learning, reliable and safe system...
research
06/11/2021

Relaxing Local Robustness

Certifiable local robustness, which rigorously precludes small-norm adve...

Please sign up or login with your details

Forgot password? Click here to reset