Structured Recovery with Heavy-tailed Measurements: A Thresholding Procedure and Optimal Rates
share
This paper introduces a general regularized thresholded least-square procedure estimating a structured signal θ_*∈R^d from the following observations: y_i = f(〈x_i, θ_*〉, ξ_i), i∈{1,2,...,N}, with i.i.d. heavy-tailed measurements {(x_i,y_i)}_i=1^N. A general framework analyzing the thresholding procedure is proposed, which boils down to computing three critical radiuses of the bounding balls of the estimator. Then, we demonstrate these critical radiuses can be tightly bounded in the following two scenarios: (1) The link function f(·) is linear, i.e. y = 〈x,θ_*〉 + ξ, with θ_* being a sparse vector and {x_i}_i=1^N being general heavy-tailed random measurements with bounded (20+ϵ)-moments. (2) The function f(·) is arbitrary unknown (possibly discontinuous) and {x_i}_i=1^N are heavy-tailed elliptical random vectors with bounded (4+ϵ)-moments. In both scenarios, we show under these rather minimal bounded moment assumptions, such a procedure and corresponding analysis lead to optimal sample and error bounds with high probability in terms of the structural properties of θ_*.
READ FULL TEXT