Sharper Sub-Weibull Concentrations: Non-asymptotic Bai-Yin Theorem

02/04/2021
by   Huiming Zhang, et al.
0

Arising in high-dimensional probability, non-asymptotic concentration inequalities play an essential role in the finite-sample theory of machine learning and high-dimensional statistics. In this article, we obtain a sharper and constants-specified concentration inequality for the summation of independent sub-Weibull random variables, which leads to a mixture of two tails: sub-Gaussian for small deviations and sub-Weibull for large deviations (from mean). These bounds improve existing bounds with sharper constants. In the application of random matrices, we derive non-asymptotic versions of Bai-Yin's theorem for sub-Weibull entries and it extends the previous result in terms of sub-Gaussian entries. In the application of negative binomial regressions, we gives the ℓ_2-error of the estimated coefficients when covariate vector X is sub-Weibull distributed with sparse structures, which is a new result for negative binomial regressions.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/08/2023

Tight Concentration Inequality for Sub-Weibull Random Variables with Generalized Bernstien Orlicz norm

Recent development in high-dimensional statistical inference has necessi...
research
03/13/2023

Tight Non-asymptotic Inference via Sub-Gaussian Intrinsic Moment Norm

In non-asymptotic statistical inferences, variance-type parameters of su...
research
05/09/2019

Random Function Priors for Correlation Modeling

The likelihood model of many high dimensional data X_n can be expressed ...
research
06/21/2022

Tyler's and Maronna's M-estimators: Non-Asymptotic Concentration Results

Tyler's and Maronna's M-estimators, as well as their regularized variant...
research
04/08/2018

Moving Beyond Sub-Gaussianity in High-Dimensional Statistics: Applications in Covariance Estimation and Linear Regression

Concentration inequalities form an essential toolkit in the study of hig...
research
08/20/2020

Simple Analysis of Johnson-Lindenstrauss Transform under Neuroscience Constraints

The paper re-analyzes a version of the celebrated Johnson-Lindenstrauss ...
research
11/28/2019

Finite impulse response models: A non-asymptotic analysis of the least squares estimator

We consider a finite impulse response system with centered independent s...

Please sign up or login with your details

Forgot password? Click here to reset