Optimal partition recovery in general graphs

10/21/2021
by   Yi Yu, et al.
0

We consider a novel graph-structured change point problem. We observe a random vector with piecewise constant mean and whose independent, sub-Gaussian coordinates correspond to the n nodes of a fixed graph. We are interested in recovering the partition of the nodes associated to the constancy regions of the mean vector. Although graph-valued signals of this type have been previously studied in the literature for the different tasks of testing for the presence of an anomalous cluster and of estimating the mean vector, no localisation results are known outside the classical case of chain graphs. When the partition 𝒮 consists of only two elements, we characterise the difficulty of the localisation problem in terms of: the maximal noise variance σ^2, the size Δ of the smaller element of the partition, the magnitude κ of the difference in the signal values and the sum of the effective resistance edge weights |∂_r(𝒮)| of the corresponding cut. We demonstrate an information theoretical lower bound implying that, in the low signal-to-noise ratio regime κ^2 Δσ^-2 |∂_r(𝒮)|^-1≲ 1, no consistent estimator of the true partition exists. On the other hand, when κ^2 Δσ^-2 |∂_r(𝒮)|^-1≳ζ_n log{r(|E|)}, with r(|E|) being the sum of effective resistance weighted edges and ζ_n being any diverging sequence in n, we show that a polynomial-time, approximate ℓ_0-penalised least squared estimator delivers a localisation error of order κ^-2σ^2 |∂_r(𝒮)| log{r(|E|)}. Aside from the log{r(|E|)} term, this rate is minimax optimal. Finally, we provide upper bounds on the localisation error for more general partitions of unknown sizes.

READ FULL TEXT
research
05/27/2021

Lattice partition recovery with dyadic CART

We study piece-wise constant signals corrupted by additive Gaussian nois...
research
10/22/2018

Univariate Mean Change Point Detection: Penalization, CUSUM and Optimality

The problem of univariate mean change point detection and localization b...
research
07/26/2022

Variance estimation in graphs with the fused lasso

We study the problem of variance estimation in general graph-structured ...
research
10/26/2020

The planted k-factor problem

We consider the problem of recovering an unknown k-factor, hidden in a w...
research
12/05/2017

Estimating linear functionals of a sparse family of Poisson means

Assume that we observe a sample of size n composed of p-dimensional sign...
research
03/12/2018

Ergodicity in Stationary Graph Processes: A Weak Law of Large Numbers

For stationary signals in time the weak law of large numbers (WLLN) stat...
research
12/05/2014

An iterative step-function estimator for graphons

Exchangeable graphs arise via a sampling procedure from measurable funct...

Please sign up or login with your details

Forgot password? Click here to reset