Conditionally Strongly Log-Concave Generative Models

05/31/2023
by   Florentin Guth, et al.
0

There is a growing gap between the impressive results of deep image generative models and classical algorithms that offer theoretical guarantees. The former suffer from mode collapse or memorization issues, limiting their application to scientific data. The latter require restrictive assumptions such as log-concavity to escape the curse of dimensionality. We partially bridge this gap by introducing conditionally strongly log-concave (CSLC) models, which factorize the data distribution into a product of conditional probability distributions that are strongly log-concave. This factorization is obtained with orthogonal projectors adapted to the data distribution. It leads to efficient parameter estimation and sampling algorithms, with theoretical guarantees, although the data distribution is not globally log-concave. We show that several challenging multiscale processes are conditionally log-concave using wavelet packet orthogonal projectors. Numerical results are shown for physical fields such as the φ^4 model and weak lensing convergence maps with higher resolution than in previous works.

READ FULL TEXT

page 3

page 7

page 8

page 9

page 15

research
05/29/2021

The query complexity of sampling from strongly log-concave distributions in one dimension

We establish the first tight lower bound of Ω(loglogκ) on the query comp...
research
06/12/2019

Flexible Modeling of Diversity with Strongly Log-Concave Distributions

Strongly log-concave (SLC) distributions are a rich class of discrete pr...
research
07/02/2020

Double-Loop Unadjusted Langevin Algorithm

A well-known first-order method for sampling from log-concave probabilit...
research
12/23/2014

Theoretical guarantees for approximate sampling from smooth and log-concave densities

Sampling from various kinds of distributions is an issue of paramount im...
research
12/21/2020

Complexity of zigzag sampling algorithm for strongly log-concave distributions

We study the computational complexity of zigzag sampling algorithm for s...
research
02/20/2023

Faster high-accuracy log-concave sampling via algorithmic warm starts

Understanding the complexity of sampling from a strongly log-concave and...
research
03/29/2019

Implicit Langevin Algorithms for Sampling From Log-concave Densities

For sampling from a log-concave density, we study implicit integrators r...

Please sign up or login with your details

Forgot password? Click here to reset