Change Point Detection for High-dimensional Linear Models: A General Tail-adaptive Approach

07/23/2022
by   Bin Liu, et al.
0

We study the change point detection problem for high-dimensional linear regression models. The existing literature mainly focuses on the change point estimation with stringent sub-Gaussian assumptions on the errors. In practice, however, there is no prior knowledge about the existence of a change point or the tail structures of errors. To address these issues, in this paper, we propose a novel tail-adaptive approach for simultaneous change point testing and estimation. The method is built on a new loss function which is a weighted combination between the composite quantile and least squared losses, allowing us to borrow information of the possible change points from both the conditional mean and quantiles. For the change point testing, based on the adjusted L_2-norm aggregation of a weighted score CUSUM process, we propose a family of individual testing statistics with different weights to account for the unknown tail structures. Through a combination of the individual tests, a tail-adaptive test is further constructed that is powerful for sparse alternatives of regression coefficients' changes under various tail structures. For the change point estimation, a family of argmax-based individual estimators is proposed once a change point is detected. In theory, for both individual and tail-adaptive tests, bootstrap procedures are proposed to approximate their limiting null distributions. Under some mild conditions, we justify the validity of the new tests in terms of size and power under the high-dimensional setup. The corresponding change point estimators are shown to be rate optimal up to a logarithm factor. Moreover, combined with the wild binary segmentation technique, a new algorithm is proposed to detect multiple change points in a tail-adaptive manner. Extensive numerical results are conducted to illustrate the competitive performance of the proposed method.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
01/29/2021

Adaptive Inference for Change Points in High-Dimensional Data

In this article, we propose a class of test statistics for a change poin...
research
09/18/2023

A Change-Point Approach to Estimating the Proportion of False Null Hypotheses in Multiple Testing

For estimating the proportion of false null hypotheses in multiple testi...
research
12/31/2020

Adaptive Quantile Computation for Brownian Bridge in Change-Point Analysis

As an example for the fast calculation of distributional parameters of G...
research
06/09/2020

On Matched Filtering for Statistical Change Point Detection

Non-parametric and distribution-free two-sample tests have been the foun...
research
01/15/2019

Change-point Detection by the Quantile LASSO Method

A simultaneous change-point detection and estimation in a piece-wise con...
research
11/23/2017

Finite sample change point inference and identification for high-dimensional mean vectors

Cumulative sum (CUSUM) statistics are widely used in the change point in...
research
07/19/2021

Inference for Change Points in High Dimensional Mean Shift Models

We consider the problem of constructing confidence intervals for the loc...

Please sign up or login with your details

Forgot password? Click here to reset