Complex energy landscapes in spiked-tensor and simple glassy models: ruggedness, arrangements of local minima and phase transitions

04/08/2018
by   Valentina Ros, et al.
0

We study rough high-dimensional landscapes in which an increasingly stronger preference for a given configuration emerges. Such energy landscapes arise in glass physics and inference. In particular we focus on random Gaussian functions, and on the spiked-tensor model and generalizations. We thoroughly analyze the statistical properties of the corresponding landscapes and characterize the associated geometrical phase transitions. In order to perform our study, we develop a framework based on the Kac-Rice method that allows to compute the complexity of the landscape, i.e. the logarithm of the typical number of stationary points and their Hessian. This approach generalizes the one used to compute rigorously the annealed complexity of mean-field glass models. We discuss its advantages with respect to previous frameworks, in particular the thermodynamical replica method which is shown to lead to partially incorrect predictions.

READ FULL TEXT

page 3

page 5

page 22

research
07/18/2019

Who is Afraid of Big Bad Minima? Analysis of Gradient-Flow in a Spiked Matrix-Tensor Model

Gradient-based algorithms are effective for many machine learning tasks,...
research
07/01/2022

The closest vector problem and the zero-temperature p-spin landscape for lossy compression

We consider a high-dimensional random constrained optimization problem i...
research
09/18/2018

Phase transition in random tensors with multiple spikes

Consider a spiked random tensor obtained as a mixture of two components:...
research
12/04/2019

Landscape Complexity for the Empirical Risk of Generalized Linear Models

We present a method to obtain the average and the typical value of the n...
research
12/05/2019

Rademacher complexity and spin glasses: A link between the replica and statistical theories of learning

Statistical learning theory provides bounds of the generalization gap, u...
research
07/04/2019

Tensor methods for the computation of MTTA in large systems of loosely interconnected components

We are concerned with the computation of the mean-time-to-absorption (MT...

Please sign up or login with your details

Forgot password? Click here to reset