Lattice partition recovery with dyadic CART

We study piece-wise constant signals corrupted by additive Gaussian noise over a d-dimensional lattice. Data of this form naturally arise in a host of applications, and the tasks of signal detection or testing, de-noising and estimation have been studied extensively in the statistical and signal processing literature. In this paper we consider instead the problem of partition recovery, i.e. of estimating the partition of the lattice induced by the constancy regions of the unknown signal, using the computationally-efficient dyadic classification and regression tree (DCART) methodology proposed by <cit.>. We prove that, under appropriate regularity conditions on the shape of the partition elements, a DCART-based procedure consistently estimates the underlying partition at a rate of order σ^2 k^* log (N)/κ^2, where k^* is the minimal number of rectangular sub-graphs obtained using recursive dyadic partitions supporting the signal partition, σ^2 is the noise variance, κ is the minimal magnitude of the signal difference among contiguous elements of the partition and N is the size of the lattice. Furthermore, under stronger assumptions, our method attains a sharper estimation error of order σ^2log(N)/κ^2, independent of k^*, which we show to be minimax rate optimal. Our theoretical guarantees further extend to the partition estimator based on the optimal regression tree estimator (ORT) of <cit.> and to the one obtained through an NP-hard exhaustive search method. We corroborate our theoretical findings and the effectiveness of DCART for partition recovery in simulations.

READ FULL TEXT
research
10/21/2021

Optimal partition recovery in general graphs

We consider a novel graph-structured change point problem. We observe a ...
research
12/19/2020

Partition of Unity Methods for Signal Processing on Graphs

Partition of unity methods (PUMs) on graphs are simple and highly adapti...
research
02/01/2021

Sampling and Complexity of Partition Function

The number partition problem is a well-known problem, which is one of 21...
research
03/20/2023

Sparse Recovery with Shuffled Labels: Statistical Limits and Practical Estimators

This paper considers the sparse recovery with shuffled labels, i.e., = ...
research
08/05/2016

Kernel Ridge Regression via Partitioning

In this paper, we investigate a divide and conquer approach to Kernel Ri...
research
06/29/2020

Sharp Statistical Guarantees for Adversarially Robust Gaussian Classification

Adversarial robustness has become a fundamental requirement in modern ma...
research
12/17/2010

Estimating Networks With Jumps

We study the problem of estimating a temporally varying coefficient and ...

Please sign up or login with your details

Forgot password? Click here to reset