Learning to Learn Single Domain Generalization

03/30/2020
by   Fengchun Qiao, et al.
4

We are concerned with a worst-case scenario in model generalization, in the sense that a model aims to perform well on many unseen domains while there is only one single domain available for training. We propose a new method named adversarial domain augmentation to solve this Out-of-Distribution (OOD) generalization problem. The key idea is to leverage adversarial training to create "fictitious" yet "challenging" populations, from which a model can learn to generalize with theoretical guarantees. To facilitate fast and desirable domain augmentation, we cast the model training in a meta-learning scheme and use a Wasserstein Auto-Encoder (WAE) to relax the widely used worst-case constraint. Detailed theoretical analysis is provided to testify our formulation, while extensive experiments on multiple benchmark datasets indicate its superior performance in tackling single domain generalization.

READ FULL TEXT
research
03/12/2021

Uncertainty-guided Model Generalization to Unseen Domains

We study a worst-case scenario in generalization: Out-of-domain generali...
research
08/05/2021

Out-of-domain Generalization from a Single Source: A Uncertainty Quantification Approach

We study a worst-case scenario in generalization: Out-of-domain generali...
research
12/01/2022

When Neural Networks Fail to Generalize? A Model Sensitivity Perspective

Domain generalization (DG) aims to train a model to perform well in unse...
research
11/27/2021

Towards Principled Disentanglement for Domain Generalization

A fundamental challenge for machine learning models is generalizing to o...
research
05/30/2018

Generalizing to Unseen Domains via Adversarial Data Augmentation

We are concerned with learning models that generalize well to different ...
research
05/21/2022

Temporal Domain Generalization with Drift-Aware Dynamic Neural Network

Temporal domain generalization is a promising yet extremely challenging ...
research
04/09/2022

The Two Dimensions of Worst-case Training and the Integrated Effect for Out-of-domain Generalization

Training with an emphasis on "hard-to-learn" components of the data has ...

Please sign up or login with your details

Forgot password? Click here to reset