Informative Dropout for Robust Representation Learning: A Shape-bias Perspective

by   Baifeng Shi, et al.

Convolutional Neural Networks (CNNs) are known to rely more on local texture rather than global shape when making decisions. Recent work also indicates a close relationship between CNN's texture-bias and its robustness against distribution shift, adversarial perturbation, random corruption, etc. In this work, we attempt at improving various kinds of robustness universally by alleviating CNN's texture bias. With inspiration from the human visual system, we propose a light-weight model-agnostic method, namely Informative Dropout (InfoDrop), to improve interpretability and reduce texture bias. Specifically, we discriminate texture from shape based on local self-information in an image, and adopt a Dropout-like algorithm to decorrelate the model output from the local texture. Through extensive experiments, we observe enhanced robustness under various scenarios (domain generalization, few-shot classification, image corruption, and adversarial perturbation). To the best of our knowledge, this work is one of the earliest attempts to improve different kinds of robustness in a unified model, shedding new light on the relationship between shape-bias and robustness, also on new approaches to trustworthy machine learning algorithms. Code is available at


page 1

page 5

page 6

page 15

page 16


Shape-Texture Debiased Neural Network Training

Shape and texture are two prominent and complementary cues for recognizi...

On the Texture Bias for Few-Shot CNN Segmentation

Despite the initial belief that Convolutional Neural Networks (CNNs) are...

Adversarial Shape Learning for Building Extraction in VHR Remote Sensing Images

Building extraction in VHR RSIs remains to be a challenging task due to ...

BiasBed – Rigorous Texture Bias Evaluation

The well-documented presence of texture bias in modern convolutional neu...

Shape-Biased Domain Generalization via Shock Graph Embeddings

There is an emerging sense that the vulnerability of Image Convolutional...

Shape Defense

Humans rely heavily on shape information to recognize objects. Conversel...

CognitiveCNN: Mimicking Human Cognitive Models to resolve Texture-Shape Bias

Recent works demonstrate the texture bias in Convolutional Neural Networ...

Code Repositories


Code for our paper "Informative Dropout for Robust Representation Learning: A Shape-bias Perspective" (ICML 2020)

view repo

Please sign up or login with your details

Forgot password? Click here to reset