(Non)-penalized Multilevel methods for non-uniformly log-concave distributions

01/23/2023
by   Maxime Egea, et al.
0

We study and develop multilevel methods for the numerical approximation of a log-concave probability π on ℝ^d, based on (over-damped) Langevin diffusion. In the continuity of <cit.> concentrated on the uniformly log-concave setting, we here study the procedure in the absence of the uniformity assumption. More precisely, we first adapt an idea of <cit.> by adding a penalization term to the potential to recover the uniformly convex setting. Such approach leads to an ε-complexity of the order ε^-5π(|.|^2)^3 d (up to logarithmic terms). Then, in the spirit of <cit.>, we propose to explore the robustness of the method in a weakly convex parametric setting where the lowest eigenvalue of the Hessian of the potential U is controlled by the function U(x)^-r for r ∈ (0,1). In this intermediary framework between the strongly convex setting (r=0) and the “Laplace case” (r=1), we show that with the help of the control of exponential moments of the Euler scheme, we can adapt some fundamental properties for the efficiency of the method. In the “best” setting where U is 𝒞^3 and U(x)^-r control the largest eigenvalue of the Hessian, we obtain an ε-complexity of the order c_ρ,δε^-2-ρ d^1+ρ/2+(4-ρ+δ) r for any ρ>0 (but with a constant c_ρ,δ which increases when ρ and δ go to 0).

READ FULL TEXT

page 1

page 2

page 3

page 4

research
09/16/2021

Multilevel-Langevin pathwise average for Gibbs approximation

We propose and study a new multilevel method for the numerical approxima...
research
02/14/2020

Local continuity of log-concave projection, with applications to estimation under model misspecification

The log-concave projection is an operator that maps a d-dimensional dist...
research
10/08/2020

On the cost of Bayesian posterior mean strategy for log-concave models

In this paper, we investigate the problem of computing Bayesian estimato...
research
12/14/2020

A spectral characterization and an approximation scheme for the Hessian eigenvalue

We revisit the k-Hessian eigenvalue problem on a smooth, bounded, (k-1)-...
research
02/19/2022

Generalized Optimistic Methods for Convex-Concave Saddle Point Problems

The optimistic gradient method has seen increasing popularity as an effi...
research
12/22/2022

Extreme eigenvalues of Log-concave Ensemble

In this paper, we consider the log-concave ensemble of random matrices, ...
research
09/25/2019

Iterative Multilevel density estimation for McKean-Vlasov SDEs via projections

In this paper, we present a generic methodology for the efficient numeri...

Please sign up or login with your details

Forgot password? Click here to reset