DeepAI AI Chat
Log In Sign Up

On maximum-likelihood estimation in the all-or-nothing regime

by   Luca Corinzia, et al.

We study the problem of estimating a rank-1 additive deformation of a Gaussian tensor according to the maximum-likelihood estimator (MLE). The analysis is carried out in the sparse setting, where the underlying signal has a support that scales sublinearly with the total number of dimensions. We show that for Bernoulli distributed signals, the MLE undergoes an all-or-nothing (AoN) phase transition, already established for the minimum mean-square-error estimator (MMSE) in the same problem. The result follows from two main technical points: (i) the connection established between the MLE and the MMSE, using the first and second-moment methods in the constrained signal space, (ii) a recovery regime for the MMSE stricter than the simple error vanishing characterization given in the standard AoN, that is here proved as a general result.


page 1

page 2

page 3

page 4


Estimation in the group action channel

We analyze the problem of estimating a signal from multiple measurements...

Second Degree Model for Multi-Compression and Recovery of Distributed Signals

We study the problem of multi-compression and reconstructing a stochasti...

Statistical thresholds for Tensor PCA

We study the statistical limits of testing and estimation for a rank one...

Maximum Likelihood Estimation for Brownian Motion Tree Models Based on One Sample

We study the problem of maximum likelihood estimation given one data sam...

Phase transition in random tensors with multiple spikes

Consider a spiked random tensor obtained as a mixture of two components:...

Information theoretic limits of learning a sparse rule

We consider generalized linear models in regimes where the number of non...

Maximum Likelihood Estimation for Learning Populations of Parameters

Consider a setting with N independent individuals, each with an unknown ...