On training locally adaptive CP

06/05/2023
by   Nicolo Colombo, et al.
0

We address the problem of making Conformal Prediction (CP) intervals locally adaptive. Most existing methods focus on approximating the object-conditional validity of the intervals by partitioning or re-weighting the calibration set. Our strategy is new and conceptually different. Instead of re-weighting the calibration data, we redefine the conformity measure through a trainable change of variables, A →ϕ_X(A), that depends explicitly on the object attributes, X. Under certain conditions and if ϕ_X is monotonic in A for any X, the transformations produce prediction intervals that are guaranteed to be marginally valid and have X-dependent sizes. We describe how to parameterize and train ϕ_X to maximize the interval efficiency. Contrary to other CP-aware training methods, the objective function is smooth and can be minimized through standard gradient methods without approximations.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/03/2022

Valid predictions of group-level random effects

Gaussian linear models with random group-level effects are the standard ...
research
07/01/2021

Well-calibrated prediction intervals for regression problems

Over the last few decades, various methods have been proposed for estima...
research
08/18/2023

Robust Uncertainty Quantification using Conformalised Monte Carlo Prediction

Deploying deep learning models in safety-critical applications remains a...
research
12/30/2022

Conformal Prediction Intervals for Remaining Useful Lifetime Estimation

The main objective of Prognostics and Health Management is to estimate t...
research
03/29/2022

Split Conformal Prediction for Dependent Data

Split conformal prediction is a popular tool to obtain predictive interv...
research
10/06/2022

Few-Shot Calibration of Set Predictors via Meta-Learned Cross-Validation-Based Conformal Prediction

Conventional frequentist learning is known to yield poorly calibrated mo...

Please sign up or login with your details

Forgot password? Click here to reset