Detection and estimation of parameters in high dimensional multiple change point regression models via ℓ_1/ℓ_0 regularization and discrete optimization

06/11/2019
by   Abhishek Kaul, et al.
0

Binary segmentation, which is sequential in nature is thus far the most widely used method for identifying multiple change points in statistical models. Here we propose a top down methodology called arbitrary segmentation that proceeds in a conceptually reverse manner. We begin with an arbitrary superset of the parametric space of the change points, and locate unknown change points by suitably filtering this space down. Critically, we reframe the problem as that of variable selection in the change point parameters, this enables the filtering down process to be achieved in a single step with the aid of an ℓ_0 regularization, thus avoiding the sequentiality of binary segmentation. We study this method under a high dimensional multiple change point linear regression model and show that rates convergence of the error in the regression and change point estimates are near optimal. We propose a simulated annealing (SA) approach to implement a key finite state space discrete optimization that arises in our method. Theoretical results are numerically supported via simulations. The proposed method is shown to possess the ability to agnostically detect the `no change' scenario. Furthermore, its computational complexity is of order O(Np^2)+SA, where SA is the cost of a SA optimization on a N(no. of change points) dimensional grid. Thus, the proposed methodology is significantly more computationally efficient than existing approaches. Finally, our theoretical results are obtained under weaker model conditions than those assumed in the current literature.

READ FULL TEXT
research
05/09/2018

Parameter estimation for high dimensional change point regression models without grid search

We propose an L1 regularized estimator for the parameters of a high dime...
research
02/16/2020

Seeded Binary Segmentation: A general methodology for fast and optimal change point detection

In recent years, there has been an increasing demand on efficient algori...
research
09/19/2022

High-dimensional data segmentation in regression settings permitting heavy tails and temporal dependence

We propose a data segmentation methodology for the high-dimensional line...
research
05/20/2021

Segmentation of high dimensional means over multi-dimensional change points and connections to regression trees

This article is motivated by the objective of providing a new analytical...
research
09/17/2019

Inference on the change point with the jump size near the boundary of the region of detectability in high dimensional time series models

We develop a projected least squares estimator for the change point para...
research
03/07/2012

Multiple Change Point Estimation in Stationary Ergodic Time Series

Given a heterogeneous time-series sample, the objective is to find point...
research
06/26/2019

Statistically and Computationally Efficient Change Point Localization in Regression Settings

Detecting when the underlying distribution changes from the observed tim...

Please sign up or login with your details

Forgot password? Click here to reset