Domain Generalization Using a Mixture of Multiple Latent Domains

11/18/2019
by   Toshihiko Matsuura, et al.
14

When domains, which represent underlying data distributions, vary during training and testing processes, deep neural networks suffer a drop in their performance. Domain generalization allows improvements in the generalization performance for unseen target domains by using multiple source domains. Conventional methods assume that the domain to which each sample belongs is known in training. However, many datasets, such as those collected via web crawling, contain a mixture of multiple latent domains, in which the domain of each sample is unknown. This paper introduces domain generalization using a mixture of multiple latent domains as a novel and more realistic scenario, where we try to train a domain-generalized model without using domain labels. To address this scenario, we propose a method that iteratively divides samples into latent domains via clustering, and which trains the domain-invariant feature extractor shared among the divided latent domains via adversarial learning. We assume that the latent domain of images is reflected in their style, and thus, utilize style features for clustering. By using these features, our proposed method successfully discovers latent domains and achieves domain generalization even if the domain labels are not given. Experiments show that our proposed method can train a domain-generalized model without using domain labels. Moreover, it outperforms conventional domain generalization methods, including those that utilize domain labels.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
08/20/2021

Discriminative Domain-Invariant Adversarial Network for Deep Domain Generalization

Domain generalization approaches aim to learn a domain invariant predict...
research
08/26/2021

Learning to Diversify for Single Domain Generalization

Domain generalization (DG) aims to generalize a model trained on multipl...
research
06/01/2020

Latent Domain Learning with Dynamic Residual Adapters

A practical shortcoming of deep neural networks is their specialization ...
research
11/15/2022

HMOE: Hypernetwork-based Mixture of Experts for Domain Generalization

Due to the domain shift, machine learning systems typically fail to gene...
research
04/16/2021

Deep Stable Learning for Out-Of-Distribution Generalization

Approaches based on deep neural networks have achieved striking performa...
research
11/03/2019

Adversarial target-invariant representation learning for domain generalization

In many applications of machine learning, the training and test set data...
research
10/13/2021

Do We Need to Directly Access the Source Datasets for Domain Generalization?

Domain generalization (DG) aims to learn a generalizable model from mult...

Please sign up or login with your details

Forgot password? Click here to reset