Fast Exact Conformalization of Lasso using Piecewise Linear Homotopy

08/01/2017
by   Jing Lei, et al.
0

Conformal prediction is a general method that converts almost any point predictor to a prediction set. The resulting set keeps good statistical properties of the original estimator under standard assumptions, and guarantees valid average coverage even when the model is misspecified. A main challenge in applying conformal prediction in modern applications is efficient computation, as it generally requires an exhaustive search over the entire output space. In this paper we develop an exact and computationally efficient conformalization of the Lasso and elastic net. The method makes use of a novel piecewise linear homotopy of the Lasso solution under perturbation of a single input sample point. As a by-product, we provide a simpler and better justified online Lasso algorithm, which may be of independent interest. Our derivation also reveals an interesting accuracy-stability trade-off in conformal inference, which is analogous to the bias-variance trade-off in traditional parameter estimation. The practical performance of the new algorithm is demonstrated using both synthetic and real data examples.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
07/19/2023

Lasso and elastic nets by orthants

We propose a new method for computing the lasso path, using the fact tha...
research
05/04/2018

Lasso, knockoff and Gaussian covariates: a comparison

Given data y and k covariates x_j one problem in linear regression is to...
research
04/24/2020

Estimating the Lasso's Effective Noise

Much of the theory for the lasso in the linear model Y = X β^* + ε hinge...
research
07/03/2020

Prediction of Spatial Point Processes: Regularized Method with Out-of-Sample Guarantees

A spatial point process can be characterized by an intensity function wh...
research
09/21/2012

A Note on the SPICE Method

In this article, we analyze the SPICE method developed in [1], and estab...
research
05/22/2022

The Selectively Adaptive Lasso

Machine learning regression methods allow estimation of functions withou...
research
08/06/2019

Debiasing Linear Prediction

Standard methods in supervised learning separate training and prediction...

Please sign up or login with your details

Forgot password? Click here to reset