DeepAI AI Chat
Log In Sign Up

Uniform Hanson-Wright type concentration inequalities for unbounded entries via the entropy method

by   Yegor Klochkov, et al.
Moscow Institute of Physics and Technology
Humboldt-Universität zu Berlin

This paper is devoted to uniform versions of the Hanson-Wright inequality for a random vector X ∈R^n with independent subgaussian components. The core technique of the paper is based on the entropy method combined with truncations of both gradients of functions of interest and of the coordinates of X itself. Our results recover, in particular, the classic uniform bound of Talagrand (1996) for Rademacher chaoses and the more recent uniform result of Adamczak (2015), which holds under certain rather strong assumptions on the distribution of X. We provide several applications of our techniques: we establish a version of the standard Hanson-Wright inequality, which is tighter in some regimes. Extending our techniques we show a version of the dimension-free matrix Bernstein inequality that holds for random matrices with a subexponential spectral norm. We apply the derived inequality to the problem of covariance estimation with missing observations and prove an almost optimal high probability version of the recent result of Lounici (2014). Finally, we show a uniform Hanson-Wright type inequality in the Ising model under Dobrushin's condition. A closely related question was posed by Marton (2003).


page 1

page 2

page 3

page 4


Sparse random tensors: concentration, regularization and applications

We prove a non-asymptotic concentration inequality of sparse inhomogeneo...

Representative endowments and uniform Gini orderings of multi-attribute inequality

For the comparison of inequality in multiple attributes the use of gener...

Non-uniform Berry-Esseen Bound by Unbounded Exchangeable Pair Approach

Since Stein presented his ideas in the seminal paper s1, there have been...

Local Dvoretzky-Kiefer-Wolfowitz confidence bands

In this paper, we revisit the concentration inequalities for the supremu...

Unifying the Brascamp-Lieb Inequality and the Entropy Power Inequality

The entropy power inequality (EPI) and the Brascamp-Lieb inequality (BLI...

Entropy inequalities for random walks and permutations

We consider a new functional inequality controlling the rate of relative...

Stein's method, smoothing and functional approximation

Stein's method for Gaussian process approximation can be used to bound t...