Domain Generalization via Domain-based Covariance Minimization

10/12/2021
by   Anqi Wu, et al.
0

Researchers have been facing a difficult problem that data generation mechanisms could be influenced by internal or external factors leading to the training and test data with quite different distributions, consequently traditional classification or regression from the training set is unable to achieve satisfying results on test data. In this paper, we address this nontrivial domain generalization problem by finding a central subspace in which domain-based covariance is minimized while the functional relationship is simultaneously maximally preserved. We propose a novel variance measurement for multiple domains so as to minimize the difference between conditional distributions across domains with solid theoretical demonstration and supports, meanwhile, the algorithm preserves the functional relationship via maximizing the variance of conditional expectations given output. Furthermore, we also provide a fast implementation that requires much less computation and smaller memory for large-scale matrix operations, suitable for not only domain generalization but also other kernel-based eigenvalue decompositions. To show the practicality of the proposed method, we compare our methods against some well-known dimension reduction and domain generalization techniques on both synthetic data and real-world applications. We show that for small-scale datasets, we are able to achieve better quantitative results indicating better generalization performance over unseen test datasets. For large-scale problems, the proposed fast implementation maintains the quantitative performance but at a substantially lower computational cost.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
07/23/2018

Domain Generalization via Conditional Invariant Representation

Domain generalization aims to apply knowledge gained from multiple label...
research
02/17/2021

Robust Domain-Free Domain Generalization with Class-aware Alignment

While deep neural networks demonstrate state-of-the-art performance on a...
research
07/20/2022

Tackling Long-Tailed Category Distribution Under Domain Shifts

Machine learning models fail to perform well on real-world applications ...
research
04/02/2023

A principled approach to model validation in domain generalization

Domain generalization aims to learn a model with good generalization abi...
research
11/21/2017

Domain Generalization by Marginal Transfer Learning

Domain generalization is the problem of assigning class labels to an unl...
research
01/10/2013

Domain Generalization via Invariant Feature Representation

This paper investigates domain generalization: How to take knowledge acq...
research
08/01/2022

Joint covariate-alignment and concept-alignment: a framework for domain generalization

In this paper, we propose a novel domain generalization (DG) framework b...

Please sign up or login with your details

Forgot password? Click here to reset