II. High Dimensional Estimation under Weak Moment Assumptions: Structured Recovery and Matrix Estimation

03/05/2020
by   Xiaohan Wei, et al.
0

The purpose of this thesis is to develop new theories on high-dimensional structured signal recovery under a rather weak assumption on the measurements that only a finite number of moments exists. High-dimensional recovery has been one of the emerging topics in the last decade partly due to the celebrated work of Candes, Romberg and Tao (e.g. [CRT06, CRT04]). The original analysis there (and the works thereafter) necessitates a strong concentration argument (namely, the restricted isometry property), which only holds for a rather restricted class of measurements with light-tailed distributions. It had long been conjectured that high-dimensional recovery is possible even if restricted isometry type conditions do not hold, but the general theory was beyond the grasp until very recently, when the works [Men14a, KM15] propose a new small-ball method. In these two papers, the authors initiated a new analysis framework for general empirical risk minimization (ERM) problems with respect to the square loss, which is robust and can potentially allow heavy-tailed loss functions. The materials in this thesis are partly inspired by [Men14a], but are of a different mindset: rather than directly analyzing the existing ERMs for signal recovery for which it is difficult to avoid strong moment assumptions, we show that, in many circumstances, by carefully re-designing the ERMs to start with, one can still achieve the minimax optimal statistical rate of signal recovery with very high probability under much weaker assumptions than existing works.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/16/2018

Structured Recovery with Heavy-tailed Measurements: A Thresholding Procedure and Optimal Rates

This paper introduces a general regularized thresholded least-square pro...
research
04/13/2018

Robust 1-Bit Compressed Sensing via Hinge Loss Minimization

This work theoretically studies the problem of estimating a structured h...
research
11/12/2019

Sparse estimation via ℓ_q optimization method in high-dimensional linear regression

In this paper, we discuss the statistical properties of the ℓ_q optimiza...
research
01/01/2014

Learning without Concentration

We obtain sharp bounds on the performance of Empirical Risk Minimization...
research
12/08/2021

Robust parameter estimation of regression model with weaker moment

This paper provides some extended results on estimating the parameter ma...
research
11/29/2022

Residual Permutation Test for High-Dimensional Regression Coefficient Testing

We consider the problem of testing whether a single coefficient is equal...
research
06/13/2018

Plug-in Regularized Estimation of High-Dimensional Parameters in Nonlinear Semiparametric Models

We develop a theory for estimation of a high-dimensional sparse paramete...

Please sign up or login with your details

Forgot password? Click here to reset