Universal Adversarial Perturbations to Understand Robustness of Texture vs. Shape-biased Training

11/23/2019
by   CK, et al.
18

Convolutional Neural Networks (CNNs) used on image classification tasks such as ImageNet have been shown to be biased towards recognizing textures rather than shapes. Recent work has attempted to alleviate this by augmenting the training dataset with shape-based examples to create Stylized-ImageNet. However, in this paper we show that models trained on this dataset remain vulnerable to Universal Adversarial Perturbations (UAPs). We use UAPs to evaluate and compare the robustness of CNN models with varying degrees of shape-based training. We also find that a posteriori fine-tuning on ImageNet negates features learned from training on Stylized-ImageNet. This study reveals an important limitation and reiterates the need for further research into understanding the robustness of CNNs for visual recognition.

READ FULL TEXT

page 2

page 4

page 7

research
11/29/2018

ImageNet-trained CNNs are biased towards texture; increasing shape bias improves accuracy and robustness

Convolutional Neural Networks (CNNs) are commonly thought to recognise o...
research
07/17/2019

Robustness properties of Facebook's ResNeXt WSL models

We investigate the robustness properties of ResNeXt image recognition mo...
research
06/20/2019

Improving the robustness of ImageNet classifiers using elements of human visual cognition

We investigate the robustness properties of image recognition models equ...
research
03/03/2020

Curriculum By Texture

Convolutional Neural Networks (CNNs) have shown impressive performance i...
research
06/13/2022

Pixel to Binary Embedding Towards Robustness for CNNs

There are several problems with the robustness of Convolutional Neural N...
research
08/24/2021

StyleAugment: Learning Texture De-biased Representations by Style Augmentation without Pre-defined Textures

Recent powerful vision classifiers are biased towards textures, while sh...
research
10/20/2021

Repaint: Improving the Generalization of Down-Stream Visual Tasks by Generating Multiple Instances of Training Examples

Convolutional Neural Networks (CNNs) for visual tasks are believed to le...

Please sign up or login with your details

Forgot password? Click here to reset