Randomized Adversarial Style Perturbations for Domain Generalization

04/04/2023
by   Taehoon Kim, et al.
0

We propose a novel domain generalization technique, referred to as Randomized Adversarial Style Perturbation (RASP), which is motivated by the observation that the characteristics of each domain are captured by the feature statistics corresponding to style. The proposed algorithm perturbs the style of a feature in an adversarial direction towards a randomly selected class, and makes the model learn against being misled by the unexpected styles observed in unseen target domains. While RASP is effective to handle domain shifts, its naive integration into the training procedure might degrade the capability of learning knowledge from source domains because it has no restriction on the perturbations of representations. This challenge is alleviated by Normalized Feature Mixup (NFM), which facilitates the learning of the original features while achieving robustness to perturbed representations via their mixup during training. We evaluate the proposed algorithm via extensive experiments on various benchmarks and show that our approach improves domain generalization performance, especially in large-scale benchmarks.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
11/08/2022

Normalization Perturbation: A Simple Domain Generalization Method for Real-World Domain Shifts

Improving model's generalizability against domain shifts is crucial, esp...
research
07/25/2020

Robust and Generalizable Visual Representation Learning via Random Convolutions

While successful for various computer vision tasks, deep neural networks...
research
04/05/2021

Domain Generalization with MixStyle

Though convolutional neural networks (CNNs) have demonstrated remarkable...
research
02/18/2023

Meta Style Adversarial Training for Cross-Domain Few-Shot Learning

Cross-Domain Few-Shot Learning (CD-FSL) is a recently emerging task that...
research
09/02/2022

Back-to-Bones: Rediscovering the Role of Backbones in Domain Generalization

Domain Generalization (DG) studies the capability of a deep learning mod...
research
11/29/2022

Towards Generalized Open Information Extraction

Open Information Extraction (OpenIE) facilitates the open-domain discove...
research
03/29/2021

RobustNet: Improving Domain Generalization in Urban-Scene Segmentation via Instance Selective Whitening

Enhancing the generalization capability of deep neural networks to unsee...

Please sign up or login with your details

Forgot password? Click here to reset