A new similarity measure for covariate shift with applications to nonparametric regression

02/06/2022
by   Reese Pathak, et al.
0

We study covariate shift in the context of nonparametric regression. We introduce a new measure of distribution mismatch between the source and target distributions that is based on the integrated ratio of probabilities of balls at a given radius. We use the scaling of this measure with respect to the radius to characterize the minimax rate of estimation over a family of Hölder continuous functions under covariate shift. In comparison to the recently proposed notion of transfer exponent, this measure leads to a sharper rate of convergence and is more fine-grained. We accompany our theory with concrete instances of covariate shift that illustrate this sharp difference.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
07/17/2023

Covariate shift in nonparametric regression with Markovian design

Covariate shift in regression problems and the associated distribution m...
research
05/06/2022

Optimally tackling covariate shift in RKHS-based nonparametric regression

We study the covariate shift problem in the context of nonparametric reg...
research
03/05/2018

Marginal Singularity, and the Benefits of Labels in Covariate-Shift

We present new minimax results that concisely capture the relative benef...
research
05/07/2023

Classification Tree Pruning Under Covariate Shift

We consider the problem of pruning a classification tree, that is, selec...
research
08/03/2022

The Power and Limitation of Pretraining-Finetuning for Linear Regression under Covariate Shift

We study linear regression under covariate shift, where the marginal dis...
research
03/29/2023

Sparse joint shift in multinomial classification

Sparse joint shift (SJS) was recently proposed as a tractable model for ...
research
12/24/2020

Dependence of variance on covariate design in nonparametric link regression

This note discusses a nonparametric approach to link regression aiming a...

Please sign up or login with your details

Forgot password? Click here to reset