Denoising and change point localisation in piecewise-constant high-dimensional regression coefficients

10/27/2021
by   Fan Wang, et al.
0

We study the theoretical properties of the fused lasso procedure originally proposed by <cit.> in the context of a linear regression model in which the regression coefficient are totally ordered and assumed to be sparse and piecewise constant. Despite its popularity, to the best of our knowledge, estimation error bounds in high-dimensional settings have only been obtained for the simple case in which the design matrix is the identity matrix. We formulate a novel restricted isometry condition on the design matrix that is tailored to the fused lasso estimator and derive estimation bounds for both the constrained version of the fused lasso assuming dense coefficients and for its penalised version. We observe that the estimation error can be dominated by either the lasso or the fused lasso rate, depending on whether the number of non-zero coefficient is larger than the number of piece-wise constant segments. Finally, we devise a post-processing procedure to recover the piecewise-constant pattern of the coefficients. Extensive numerical experiments support our theoretical findings.

READ FULL TEXT
research
10/03/2009

A path algorithm for the Fused Lasso Signal Approximator

The Lasso is a very well known penalized regression model, which adds an...
research
01/29/2015

High-Dimensional Longitudinal Classification with the Multinomial Fused Lasso

We study regularized estimation in high-dimensional longitudinal classif...
research
01/15/2018

On the Complexity of the Weighted Fused Lasso

The solution path of the 1D fused lasso for an n-dimensional input is pi...
research
01/15/2018

On the Complexity of the Weighted Fussed Lasso

The solution path of the 1D fused lasso for an n-dimensional input is pi...
research
08/16/2007

Piecewise linear regularized solution paths

We consider the generic regularized optimization problem β̂(λ)=_βL(y,Xβ)...
research
09/01/2023

Interpretation of High-Dimensional Linear Regression: Effects of Nullspace and Regularization Demonstrated on Battery Data

High-dimensional linear regression is important in many scientific field...
research
07/05/2021

Optimal Estimation of Brownian Penalized Regression Coefficients

In this paper we introduce a new methodology to determine an optimal coe...

Please sign up or login with your details

Forgot password? Click here to reset