On maximum-likelihood estimation in the all-or-nothing regime

01/25/2021
by   Luca Corinzia, et al.
9

We study the problem of estimating a rank-1 additive deformation of a Gaussian tensor according to the maximum-likelihood estimator (MLE). The analysis is carried out in the sparse setting, where the underlying signal has a support that scales sublinearly with the total number of dimensions. We show that for Bernoulli distributed signals, the MLE undergoes an all-or-nothing (AoN) phase transition, already established for the minimum mean-square-error estimator (MMSE) in the same problem. The result follows from two main technical points: (i) the connection established between the MLE and the MMSE, using the first and second-moment methods in the constrained signal space, (ii) a recovery regime for the MMSE stricter than the simple error vanishing characterization given in the standard AoN, that is here proved as a general result.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
01/13/2018

Estimation in the group action channel

We analyze the problem of estimating a signal from multiple measurements...
research
11/05/2021

Second Degree Model for Multi-Compression and Recovery of Distributed Signals

We study the problem of multi-compression and reconstructing a stochasti...
research
12/08/2018

Statistical thresholds for Tensor PCA

We study the statistical limits of testing and estimation for a rank one...
research
12/01/2021

Maximum Likelihood Estimation for Brownian Motion Tree Models Based on One Sample

We study the problem of maximum likelihood estimation given one data sam...
research
09/18/2018

Phase transition in random tensors with multiple spikes

Consider a spiked random tensor obtained as a mixture of two components:...
research
06/19/2020

Information theoretic limits of learning a sparse rule

We consider generalized linear models in regimes where the number of non...
research
04/10/2014

Open problem: Tightness of maximum likelihood semidefinite relaxations

We have observed an interesting, yet unexplained, phenomenon: Semidefini...

Please sign up or login with your details

Forgot password? Click here to reset