Strong replica symmetry for high-dimensional disordered log-concave Gibbs measures

09/27/2020
by   Jean Barbier, et al.
0

We consider a generic class of log-concave, possibly random, (Gibbs) measures. Using a new type of perturbation we prove concentration of an infinite family of order parameters called multioverlaps. These completely parametrise the quenched Gibbs measure of the system, so that their self-averaging behavior implies a simple representation of asymptotic Gibbs measures, as well as decoupling of the variables at hand in a strong sense. Our concentration results may prove themselves useful in several contexts. In particular in machine learning and high-dimensional inference, log-concave measures appear in convex empirical risk minimisation, maximum a-posteriori inference or M-estimation. We believe that our results may be applicable in establishing some type of "replica symmetric formulas" for the free energy, inference or generalisation error in such settings.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/17/2022

Moments, Concentration, and Entropy of Log-Concave Distributions

We utilize and extend a simple and classical mechanism, combining log-co...
research
05/06/2020

Strong replica symmetry in high-dimensional optimal Bayesian inference

We consider generic optimal Bayesian inference, namely, models of signal...
research
02/10/2016

High Dimensional Inference with Random Maximum A-Posteriori Perturbations

This paper presents a new approach, called perturb-max, for high-dimensi...
research
02/26/2018

Dimension-free Information Concentration via Exp-Concavity

Information concentration of probability measures have important implica...
research
12/08/2020

Gibbs posterior concentration rates under sub-exponential type losses

Bayesian posterior distributions are widely used for inference, but thei...
research
03/18/2019

Bi-log-concavity: some properties and some remarks towards a multi-dimensional extension

Bi-log-concavity of probability measures is a univariate extension of th...
research
12/22/2022

Extreme eigenvalues of Log-concave Ensemble

In this paper, we consider the log-concave ensemble of random matrices, ...

Please sign up or login with your details

Forgot password? Click here to reset