Improving Robustness to Out-of-Distribution Data by Frequency-based Augmentation

09/06/2022
by   Koki Mukai, et al.
0

Although Convolutional Neural Networks (CNNs) have high accuracy in image recognition, they are vulnerable to adversarial examples and out-of-distribution data, and the difference from human recognition has been pointed out. In order to improve the robustness against out-of-distribution data, we present a frequency-based data augmentation technique that replaces the frequency components with other images of the same class. When the training data are CIFAR10 and the out-of-distribution data are SVHN, the Area Under Receiver Operating Characteristic (AUROC) curve of the model trained with the proposed method increases from 89.22% to 98.15%, and further increased to 98.59% when combined with another data augmentation method. Furthermore, we experimentally demonstrate that the robust model for out-of-distribution data uses a lot of high-frequency components of the image.

READ FULL TEXT
research
05/28/2019

High Frequency Component Helps Explain the Generalization of Convolutional Neural Networks

We investigate the relationship between the frequency spectrum of image ...
research
10/28/2022

Rawgment: Noise-Accounted RAW Augmentation Enables Recognition in a Wide Variety of Environments

Image recognition models that can work in challenging environments (e.g....
research
12/20/2021

PRONTO: Preamble Overhead Reduction with Neural Networks for Coarse Synchronization

In IEEE 802.11 WiFi-based waveforms, the receiver performs coarse time a...
research
03/30/2021

Improving robustness against common corruptions with frequency biased models

CNNs perform remarkably well when the training and test distributions ar...
research
07/19/2023

What do neural networks learn in image classification? A frequency shortcut perspective

Frequency analysis is useful for understanding the mechanisms of represe...
research
03/03/2021

Bulk Production Augmentation Towards Explainable Melanoma Diagnosis

Although highly accurate automated diagnostic techniques for melanoma ha...
research
07/21/2023

HybridAugment++: Unified Frequency Spectra Perturbations for Model Robustness

Convolutional Neural Networks (CNN) are known to exhibit poor generaliza...

Please sign up or login with your details

Forgot password? Click here to reset