Joint covariate-alignment and concept-alignment: a framework for domain generalization

08/01/2022
by   Thuan Nguyen, et al.
0

In this paper, we propose a novel domain generalization (DG) framework based on a new upper bound to the risk on the unseen domain. Particularly, our framework proposes to jointly minimize both the covariate-shift as well as the concept-shift between the seen domains for a better performance on the unseen domain. While the proposed approach can be implemented via an arbitrary combination of covariate-alignment and concept-alignment modules, in this work we use well-established approaches for distributional alignment namely, Maximum Mean Discrepancy (MMD) and covariance Alignment (CORAL), and use an Invariant Risk Minimization (IRM)-based approach for concept alignment. Our numerical results show that the proposed methods perform as well as or better than the state-of-the-art for domain generalization on several data sets.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
09/17/2022

Mitigating Both Covariate and Conditional Shift for Domain Generalization

Domain generalization (DG) aims to learn a model on several source domai...
research
04/02/2023

A principled approach to model validation in domain generalization

Domain generalization aims to learn a model with good generalization abi...
research
10/07/2021

Scale Invariant Domain Generalization Image Recapture Detection

Recapturing and rebroadcasting of images are common attack methods in in...
research
10/26/2022

Trade-off between reconstruction loss and feature alignment for domain generalization

Domain generalization (DG) is a branch of transfer learning that aims to...
research
11/19/2021

Maximum Mean Discrepancy for Generalization in the Presence of Distribution and Missingness Shift

Covariate shifts are a common problem in predictive modeling on real-wor...
research
09/04/2021

Barycenteric distribution alignment and manifold-restricted invertibility for domain generalization

For the Domain Generalization (DG) problem where the hypotheses are comp...
research
10/12/2021

Domain Generalization via Domain-based Covariance Minimization

Researchers have been facing a difficult problem that data generation me...

Please sign up or login with your details

Forgot password? Click here to reset