Conformal Prediction Under Covariate Shift

04/12/2019
by   Rina Foygel Barber, et al.
0

We extend conformal prediction methodology beyond the case of exchangeable data. In particular, we show that a weighted version of conformal prediction can be used to compute distribution-free prediction intervals for problems in which the test and training covariate distributions differ, but the likelihood ratio between these two distributions is known---or, in practice, can be estimated accurately with access to a large set of unlabeled data (test covariate points). Our weighted extension of conformal prediction also applies more generally, to settings in which the data satisfies a certain weighted notion of exchangeability. We discuss other potential applications of our new conformal methodology, including latent variable and missing data problems.

READ FULL TEXT
research
03/03/2022

Doubly Robust Calibration of Prediction Sets under Covariate Shift

Conformal prediction has received tremendous attention in recent years a...
research
08/27/2019

Locally Optimized Random Forests

Standard supervised learning procedures are validated against a test set...
research
06/24/2014

Combining predictions from linear models when training and test inputs differ

Methods for combining predictions from different models in a supervised ...
research
11/01/2022

Missing data interpolation in integrative multi-cohort analysis with disparate covariate information

Integrative analysis of datasets generated by multiple cohorts is a wide...
research
11/29/2017

Dimension Reduction for Robust Covariate Shift Correction

In the covariate shift learning scenario, the training and test covariat...
research
07/18/2023

Model-free selective inference under covariate shift via weighted conformal p-values

This paper introduces weighted conformal p-values for model-free selecti...
research
07/24/2023

Safety Performance of Neural Networks in the Presence of Covariate Shift

Covariate shift may impact the operational safety performance of neural ...

Please sign up or login with your details

Forgot password? Click here to reset