Conformal Prediction Regions for Time Series using Linear Complementarity Programming

04/03/2023
by   Matthew Cleaveland, et al.
0

Conformal prediction is a statistical tool for producing prediction regions of machine learning models that are valid with high probability. However, applying conformal prediction to time series data leads to conservative prediction regions. In fact, to obtain prediction regions over T time steps with confidence 1-δ, previous works require that each individual prediction region is valid with confidence 1-δ/T. We propose an optimization-based method for reducing this conservatism to enable long horizon planning and verification when using learning-enabled time series predictors. Instead of considering prediction errors individually at each time step, we consider a parameterized prediction error over multiple time steps. By optimizing the parameters over an additional dataset, we find prediction regions that are not conservative. We show that this problem can be cast as a mixed integer linear complementarity program (MILCP), which we then relax into a linear complementarity program (LCP). Additionally, we prove that the relaxed LP has the same optimal cost as the original MILCP. Finally, we demonstrate the efficacy of our method on a case study using pedestrian trajectory predictors.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/25/2021

Applying Regression Conformal Prediction with Nearest Neighbors to time series data

In this paper, we apply conformal prediction to time series data. Confor...
research
05/31/2023

EAMDrift: An interpretable self retrain model for time series

The use of machine learning for time series prediction has become increa...
research
01/19/2021

Optimizing Hyperparameters in CNNs using Bilevel Programming in Time Series Data

Hyperparameter optimization has remained a central topic within the mach...
research
07/28/2022

A general framework for multi-step ahead adaptive conformal heteroscedastic time series forecasting

The exponential growth of machine learning (ML) has prompted a great dea...
research
10/19/2022

Safe Planning in Dynamic Environments using Conformal Prediction

We propose a framework for planning in unknown dynamic environments with...
research
07/22/2013

Multi-horizon solar radiation forecasting for Mediterranean locations using time series models

Considering the grid manager's point of view, needs in terms of predicti...
research
10/28/2021

Using Time-Series Privileged Information for Provably Efficient Learning of Prediction Models

We study prediction of future outcomes with supervised models that use p...

Please sign up or login with your details

Forgot password? Click here to reset