Information Geometrically Generalized Covariate Shift Adaptation

04/19/2023
by   Masanari Kimura, et al.
0

Many machine learning methods assume that the training and test data follow the same distribution. However, in the real world, this assumption is very often violated. In particular, the phenomenon that the marginal distribution of the data changes is called covariate shift, one of the most important research topics in machine learning. We show that the well-known family of covariate shift adaptation methods is unified in the framework of information geometry. Furthermore, we show that parameter search for geometrically generalized covariate shift adaptation method can be achieved efficiently. Numerical experiments show that our generalization can achieve better performance than the existing methods it encompasses.

READ FULL TEXT

page 13

page 38

page 39

page 41

research
10/02/2020

Covariate Shift Adaptation in High-Dimensional and Divergent Distributions

In real world applications of supervised learning methods, training and ...
research
07/08/2020

A One-step Approach to Covariate Shift Adaptation

A default assumption in many machine learning scenarios is that the trai...
research
05/04/2022

Estimation of prediction error with known covariate shift

In supervised learning, the estimation of prediction error on unlabeled ...
research
12/06/2022

A Learning Based Hypothesis Test for Harmful Covariate Shift

The ability to quickly and accurately identify covariate shift at test t...
research
10/14/2020

A Distribution-Free Test of Covariate Shift Using Conformal Prediction

Covariate shift is a common and important assumption in transfer learnin...
research
04/18/2023

A Domain-Region Based Evaluation of ML Performance Robustness to Covariate Shift

Most machine learning methods assume that the input data distribution is...
research
05/17/2022

A unified framework for dataset shift diagnostics

Most machine learning (ML) methods assume that the data used in the trai...

Please sign up or login with your details

Forgot password? Click here to reset