When is Importance Weighting Correction Needed for Covariate Shift Adaptation?

03/07/2023
by   Davit Gogolashvili, et al.
0

This paper investigates when the importance weighting (IW) correction is needed to address covariate shift, a common situation in supervised learning where the input distributions of training and test data differ. Classic results show that the IW correction is needed when the model is parametric and misspecified. In contrast, recent results indicate that the IW correction may not be necessary when the model is nonparametric and well-specified. We examine the missing case in the literature where the model is nonparametric and misspecified, and show that the IW correction is needed for obtaining the best approximation of the true unknown function for the test distribution. We do this by analyzing IW-corrected kernel ridge regression, covering a variety of settings, including parametric and nonparametric models, well-specified and misspecified settings, and arbitrary weighting functions.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/18/2022

Importance Weighting Correction of Regularized Least-Squares for Covariate and Target Shifts

In many real world problems, the training data and test data have differ...
research
11/29/2017

Dimension Reduction for Robust Covariate Shift Correction

In the covariate shift learning scenario, the training and test covariat...
research
10/02/2020

Covariate Shift Adaptation in High-Dimensional and Divergent Distributions

In real world applications of supervised learning methods, training and ...
research
10/06/2020

Doubly Robust Covariate Shift Regression with Semi-nonparametric Nuisance Models

Importance weighting is naturally used to adjust for covariate shift. Ho...
research
10/14/2019

Robust Importance Weighting for Covariate Shift

In many learning problems, the training and testing data follow differen...
research
09/21/2018

Intractable Likelihood Regression for Covariate Shift by Kernel Mean Embedding

Simulation plays an essential role in comprehending a target system in m...
research
12/19/2021

Rethinking Importance Weighting for Transfer Learning

A key assumption in supervised learning is that training and test data f...

Please sign up or login with your details

Forgot password? Click here to reset