On the universal distribution of the coverage in split conformal prediction

03/05/2023
by   Paulo C. Marques F, et al.
0

Two additional universal properties are established in the split conformal prediction framework. In a regression setting with exchangeable data, we determine the exact distribution of the coverage of prediction sets for a finite horizon of future observables, as well as the exact distribution of its almost sure limit. The results hold for finite training and calibration samples, and both distributions are determined solely by the nominal miscoverage level and the calibration sample size.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/26/2022

Distribution-Free Finite-Sample Guarantees and Split Conformal Prediction

Modern black-box predictive models are often accompanied by weak perform...
research
09/15/2023

Heteroskedastic conformal regression

Conformal prediction, and split conformal prediction as a specific imple...
research
02/26/2021

Permutation Tests at Nonparametric Rates

Classical two-sample permutation tests for equality of distributions hav...
research
05/31/2023

Adaptive Conformal Regression with Jackknife+ Rescaled Scores

Conformal regression provides prediction intervals with global coverage ...
research
07/24/2020

CD-split: efficient conformal regions in high dimensions

Conformal methods create prediction bands that control average coverage ...
research
05/28/2022

Approximate Conditional Coverage via Neural Model Approximations

Constructing reliable prediction sets is an obstacle for applications of...
research
07/16/2020

Predicting the Number of Future Events

This paper describes prediction methods for the number of future events ...

Please sign up or login with your details

Forgot password? Click here to reset