Domain Generalization through the Lens of Angular Invariance

10/28/2022
by   Yujie Jin, et al.
0

Domain generalization (DG) aims at generalizing a classifier trained on multiple source domains to an unseen target domain with domain shift. A common pervasive theme in existing DG literature is domain-invariant representation learning with various invariance assumptions. However, prior works restrict themselves to a radical assumption for realworld challenges: If a mapping induced by a deep neural network (DNN) could align the source domains well, then such a mapping aligns a target domain as well. In this paper, we simply take DNNs as feature extractors to relax the requirement of distribution alignment. Specifically, we put forward a novel angular invariance and the accompanied norm shift assumption. Based on the proposed term of invariance, we propose a novel deep DG method called Angular Invariance Domain Generalization Network (AIDGN). The optimization objective of AIDGN is developed with a von-Mises Fisher (vMF) mixture model. Extensive experiments on multiple DG benchmark datasets validate the effectiveness of the proposed AIDGN method.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/02/2021

Contrastive ACE: Domain Generalization Through Alignment of Causal Mechanisms

Domain generalization aims to learn knowledge invariant across different...
research
03/31/2022

CADG: A Model Based on Cross Attention for Domain Generalization

In Domain Generalization (DG) tasks, models are trained by using only tr...
research
12/14/2021

A Style and Semantic Memory Mechanism for Domain Generalization

Mainstream state-of-the-art domain generalization algorithms tend to pri...
research
06/24/2022

Gated Domain Units for Multi-source Domain Generalization

Distribution shift (DS) is a common problem that deteriorates the perfor...
research
05/30/2021

On the benefits of representation regularization in invariance based domain generalization

A crucial aspect in reliable machine learning is to design a deployable ...
research
05/09/2021

A Bit More Bayesian: Domain-Invariant Learning with Uncertainty

Domain generalization is challenging due to the domain shift and the unc...
research
11/03/2019

Adversarial target-invariant representation learning for domain generalization

In many applications of machine learning, the training and test set data...

Please sign up or login with your details

Forgot password? Click here to reset