Sampling from convex sets with a cold start using multiscale decompositions

11/08/2022
by   Hariharan Narayanan, et al.
0

Running a random walk in a convex body K⊆ℝ^n is a standard approach to sample approximately uniformly from the body. The requirement is that from a suitable initial distribution, the distribution of the walk comes close to the uniform distribution π_K on K after a number of steps polynomial in n and the aspect ratio R/r (i.e., when rB_2 ⊆ K ⊆ RB_2). Proofs of rapid mixing of such walks often require the probability density η_0 of the initial distribution with respect to π_K to be at most poly(n): this is called a "warm start". Achieving a warm start often requires non-trivial pre-processing before starting the random walk. This motivates proving rapid mixing from a "cold start", wherein η_0 can be as high as exp(poly(n)). Unlike warm starts, a cold start is usually trivial to achieve. However, a random walk need not mix rapidly from a cold start: an example being the well-known "ball walk". On the other hand, Lovász and Vempala proved that the "hit-and-run" random walk mixes rapidly from a cold start. For the related coordinate hit-and-run (CHR) walk, which has been found to be promising in computational experiments, rapid mixing from a warm start was proved only recently but the question of rapid mixing from a cold start remained open. We construct a family of random walks inspired by classical decompositions of subsets of ℝ^n into countably many axis-aligned dyadic cubes. We show that even with a cold start, the mixing times of these walks are bounded by a polynomial in n and the aspect ratio. Our main technical ingredient is an isoperimetric inequality for K for a metric that magnifies distances between points close to the boundary of K. As a corollary, we show that the CHR walk also mixes rapidly both from a cold start and from a point not too close to the boundary of K.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
09/29/2020

On the mixing time of coordinate Hit-and-Run

We obtain a polynomial upper bound on the mixing time T_CHR(ϵ) of the co...
research
03/06/2018

John's Walk

We present an affine-invariant random walk for drawing uniform random sa...
research
12/01/2022

Hit-and-run mixing via localization schemes

We analyze the hit-and-run algorithm for sampling uniformly from an isot...
research
11/06/2021

Rapid mixing of the hardcore Glauber dynamics and other Markov chains in bounded-treewidth graphs

We give a new rapid mixing result for a natural random walk on the indep...
research
02/11/2014

On Zeroth-Order Stochastic Convex Optimization via Random Walks

We propose a method for zeroth order stochastic convex optimization that...
research
01/25/2021

Rapid mixing in unimodal landscapes and efficient simulatedannealing for multimodal distributions

We consider nearest neighbor weighted random walks on the d-dimensional ...
research
09/23/2020

Convergence of Gibbs Sampling: Coordinate Hit-and-Run Mixes Fast

The Gibbs Sampler is a general method for sampling high-dimensional dist...

Please sign up or login with your details

Forgot password? Click here to reset