Split Localized Conformal Prediction

06/27/2022
by   Xing Han, et al.
5

Conformal prediction is a simple and powerful tool that can quantify uncertainty without any distributional assumptions. However, existing methods can only provide an average coverage guarantee, which is not ideal compared to the stronger conditional coverage guarantee. Although achieving exact conditional coverage is proven to be impossible, approximating conditional coverage is still an important research direction. In this paper, we propose a modified non-conformity score by leveraging local approximation of the conditional distribution. The modified score inherits the spirit of split conformal methods, which is simple and efficient compared with full conformal methods but better approximates conditional coverage guarantee. Empirical results on various datasets, including a high dimension age regression on image, demonstrate that our method provides tighter intervals compared to existing methods.

READ FULL TEXT

page 2

page 18

page 19

page 20

research
05/07/2022

Training-conditional coverage for distribution-free predictive inference

The field of distribution-free predictive inference provides tools for p...
research
06/15/2021

Localized Conformal Prediction: A Generalized Inference Framework for Conformal Prediction

We propose a new inference framework called localized conformal predicti...
research
07/24/2020

CD-split: efficient conformal regions in high dimensions

Conformal methods create prediction bands that control average coverage ...
research
06/02/2022

Practical Adversarial Multivalid Conformal Prediction

We give a simple, generic conformal prediction method for sequential pre...
research
06/10/2023

Distribution-free inference with hierarchical data

This paper studies distribution-free inference in settings where the dat...
research
03/22/2023

Adaptive Conformal Prediction by Reweighting Nonconformity Score

Despite attractive theoretical guarantees and practical successes, Predi...
research
03/29/2022

Split Conformal Prediction for Dependent Data

Split conformal prediction is a popular tool to obtain predictive interv...

Please sign up or login with your details

Forgot password? Click here to reset