Domain Invariant Representation Learning with Domain Density Transformations

02/09/2021
by   A. Tuan Nguyen, et al.
0

Domain generalization refers to the problem where we aim to train a model on data from a set of source domains so that the model can generalize to unseen target domains. Naively training a model on the aggregate set of data (pooled from all source domains) has been shown to perform suboptimally, since the information learned by that model might be domain-specific and generalize imperfectly to target domains. To tackle this problem, a predominant approach is to find and learn some domain-invariant information in order to use it for the prediction task. In this paper, we propose a theoretically grounded method to learn a domain-invariant representation by enforcing the representation network to be invariant under all transformation functions among domains. We also show how to use generative adversarial networks to learn such domain transformations to implement our method in practice. We demonstrate the effectiveness of our method on several widely used datasets for the domain generalization problem, on all of which we achieve competitive results with state-of-the-art models.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/18/2021

Exploiting Domain-Specific Features to Enhance Domain Generalization

Domain Generalization (DG) aims to train a model, from multiple observed...
research
02/14/2023

Robust Representation Learning with Self-Distillation for Domain Generalization

Domain generalization is a challenging problem in machine learning, wher...
research
03/30/2021

Progressive Domain Expansion Network for Single Domain Generalization

Single domain generalization is a challenging case of model generalizati...
research
09/13/2021

Variational Disentanglement for Domain Generalization

Domain generalization aims to learn an invariant model that can generali...
research
07/21/2020

Domain Generalization with Optimal Transport and Metric Learning

Generalizing knowledge to unseen domains, where data and labels are unav...
research
07/25/2019

Domain Generalization via Multidomain Discriminant Analysis

Domain generalization (DG) aims to incorporate knowledge from multiple s...
research
05/24/2019

DIVA: Domain Invariant Variational Autoencoders

We consider the problem of domain generalization, namely, how to learn r...

Please sign up or login with your details

Forgot password? Click here to reset