On Robustness and Transferability of Convolutional Neural Networks

07/16/2020
by   Josip Djolonga, et al.
15

Modern deep convolutional networks (CNNs) are often criticized for not generalizing under distributional shifts. However, several recent breakthroughs in transfer learning suggest that these networks can cope with severe distribution shifts and successfully adapt to new tasks from a few training examples. In this work we revisit the out-of-distribution and transfer performance of modern image classification CNNs and investigate the impact of the pre-training data size, the model scale, and the data preprocessing pipeline. We find that increasing both the training set and model sizes significantly improve the distributional shift robustness. Furthermore, we show that, perhaps surprisingly, simple changes in the preprocessing such as modifying the image resolution can significantly mitigate robustness issues in some cases. Finally, we outline the shortcomings of existing robustness evaluation datasets and introduce a synthetic dataset we use for a systematic analysis across common factors of variation.

READ FULL TEXT

page 5

page 7

page 15

page 16

page 18

page 20

page 21

page 22

research
07/01/2020

Measuring Robustness to Natural Distribution Shifts in Image Classification

We study how robust current ImageNet models are to distribution shifts a...
research
07/17/2023

Revisiting the Robustness of the Minimum Error Entropy Criterion: A Transfer Learning Case Study

Coping with distributional shifts is an important part of transfer learn...
research
05/25/2018

Using transfer learning to detect galaxy mergers

We investigate the use of deep convolutional neural networks (deep CNNs)...
research
04/02/2022

CNN Filter DB: An Empirical Investigation of Trained Convolutional Filters

Currently, many theoretical as well as practically relevant questions to...
research
12/05/2019

AugMix: A Simple Data Processing Method to Improve Robustness and Uncertainty

Modern deep neural networks can achieve high accuracy when the training ...
research
09/19/2023

A Configurable Library for Generating and Manipulating Maze Datasets

Understanding how machine learning models respond to distributional shif...
research
02/05/2018

A Method for Restoring the Training Set Distribution in an Image Classifier

Convolutional Neural Networks are a well-known staple of modern image cl...

Please sign up or login with your details

Forgot password? Click here to reset