Localizing Changes in High-Dimensional Regression Models

10/20/2020
by   Alessandro Rinaldo, et al.
0

This paper addresses the problem of localizing change points in high-dimensional linear regression models with piecewise constant regression coefficients. We develop a dynamic programming approach to estimate the locations of the change points whose performance improves upon the current state-of-the-art, even as the dimensionality, the sparsity of the regression coefficients, the temporal spacing between two consecutive change points, and the magnitude of the difference of two consecutive regression coefficient vectors are allowed to vary with the sample size. Furthermore, we devise a computationally-efficient refinement procedure that provably reduces the localization error of preliminary estimates of the change points. We demonstrate minimax lower bounds on the localization error that nearly match the upper bound on the localization error of our methodology and show that the signal-to-noise condition we impose is essentially the weakest possible based on information-theoretic arguments. Extensive numerical results support our theoretical findings, and experiments on real air quality data reveal change points supported by historical information not used by the algorithm.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
09/12/2019

Localizing Changes in High-Dimensional Vector Autoregressive Processes

Autoregressive models capture stochastic processes in which past realiza...
research
10/29/2019

Optimal nonparametric multivariate change point detection and localization

We study the multivariate nonparametric change point detection problem, ...
research
05/25/2022

Detecting Abrupt Changes in Sequential Pairwise Comparison Data

The Bradley-Terry-Luce (BTL) model is a classic and very popular statist...
research
01/26/2023

Divide and Conquer Dynamic Programming: An Almost Linear Time Change Point Detection Methodology in High Dimensions

We develop a novel, general and computationally efficient framework, cal...
research
07/20/2020

Localising change points in piecewise polynomials of general degrees

In this paper we are concerned with a sequence of univariate random vari...
research
12/17/2019

Performance of regression models as a function of experiment noise

A challenge in developing machine learning regression models is that it ...
research
09/19/2022

High-dimensional data segmentation in regression settings permitting heavy tails and temporal dependence

We propose a data segmentation methodology for the high-dimensional line...

Please sign up or login with your details

Forgot password? Click here to reset