Rates of convergence for nonparametric estimation of singular distributions using generative adversarial networks

02/07/2022
by   Minwoo Chae, et al.
0

We consider generative adversarial networks (GAN) for estimating parameters in a deep generative model. The data-generating distribution is assumed to concentrate around some low-dimensional structure, making the target distribution singular to the Lebesgue measure. Under this assumption, we obtain convergence rates of a GAN type estimator with respect to the Wasserstein metric. The convergence rate depends only on the noise level, intrinsic dimension and smoothness of the underlying structure. Furthermore, the rate is faster than that obtained by likelihood approaches, which provides insights into why GAN approaches perform better in many real problems. A lower bound of the minimax optimal rate is also investigated.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
12/21/2017

How Well Can Generative Adversarial Networks Learn Densities: A Nonparametric View

We study in this paper the rate of convergence for learning densities un...
research
05/09/2021

A likelihood approach to nonparametric estimation of a singular distribution using deep generative models

We investigate statistical properties of a likelihood approach to nonpar...
research
12/21/2017

How Well Can Generative Adversarial Networks (GAN) Learn Densities: A Nonparametric View

We study in this paper the rate of convergence for learning densities un...
research
05/11/2023

Minimax optimal density estimation using a shallow generative model with a one-dimensional latent variable

The deep generative model yields an implicit estimator for the unknown d...
research
06/23/2023

On the Convergence Rate of Gaussianization with Random Rotations

Gaussianization is a simple generative model that can be trained without...
research
02/18/2022

Minimax Rate of Distribution Estimation on Unknown Submanifold under Adversarial Losses

Statistical inference from high-dimensional data with low-dimensional st...
research
03/06/2021

Metropolis-Hastings via Classification

This paper develops a Bayesian computational platform at the interface b...

Please sign up or login with your details

Forgot password? Click here to reset