Intrinsic Multi-scale Evaluation of Generative Models

05/27/2019
by   Anton Tsitsulin, et al.
5

Generative models are often used to sample high-dimensional data points from a manifold with small intrinsic dimension. Existing techniques for comparing generative models focus on global data properties such as mean and covariance; in that sense, they are extrinsic and uni-scale. We develop the first, to our knowledge, intrinsic and multi-scale method for characterizing and comparing underlying data manifolds, based on comparing all data moments by lower-bounding the spectral notion of the Gromov-Wasserstein distance between manifolds. In a thorough experimental study, we demonstrate that our method effectively evaluates the quality of generative models; further, we showcase its efficacy in discerning the disentanglement process in neural networks.

READ FULL TEXT
research
11/21/2017

The Riemannian Geometry of Deep Generative Models

Deep generative models learn a mapping from a low dimensional latent spa...
research
07/01/2018

Heuristic Framework for Multi-Scale Testing of the Multi-Manifold Hypothesis

When analyzing empirical data, we often find that global linear models o...
research
06/08/2021

Manifold Topology Divergence: a Framework for Comparing Data Manifolds

We develop a framework for comparing data manifolds, aimed, in particula...
research
05/14/2019

Learning Generative Models across Incomparable Spaces

Generative Adversarial Networks have shown remarkable success in learnin...
research
06/28/2018

Learning Implicit Generative Models with the Method of Learned Moments

We propose a method of moments (MoM) algorithm for training large-scale ...
research
06/27/2019

Curriculum Learning for Deep Generative Models with Clustering

Training generative models like generative adversarial networks (GANs) a...
research
06/02/2022

Score-Based Generative Models Detect Manifolds

Score-based generative models (SGMs) need to approximate the scores ∇log...

Please sign up or login with your details

Forgot password? Click here to reset