Ratio Matching MMD Nets: Low dimensional projections for effective deep generative models

05/31/2018
by   Akash Srivastava, et al.
0

Deep generative models can learn to generate realistic-looking images on several natural image datasets, but many of the most effective methods are adversarial methods, which require careful balancing of training between a generator network and a discriminator network. Maximum mean discrepancy networks (MMD-nets) avoid this issue using the kernel trick, but unfortunately they have not on their own been able to match the performance of adversarial training. We present a new method of training MMD-nets, based on learning a mapping of samples from the data and from the model into a lower dimensional space, in which MMD training can be more effective. We call these networks ratio matching MMD networks (RMMMDnets). We train the mapping to preserve density ratios between the densities over the low-dimensional space and the original space. This ensures that matching the model distribution to the data in the low-dimensional space will also match the original distributions. We show that RM-MMDnets have better performance and better stability than recent adversarial methods for training MMD-nets.

READ FULL TEXT

page 7

page 12

research
05/09/2021

A likelihood approach to nonparametric estimation of a singular distribution using deep generative models

We investigate statistical properties of a likelihood approach to nonpar...
research
03/07/2020

MatchingGAN: Matching-based Few-shot Image Generation

To generate new images for a given category, most deep generative models...
research
05/05/2014

K-NS: Section-Based Outlier Detection in High Dimensional Space

Finding rare information hidden in a huge amount of data from the Intern...
research
06/18/2018

BinGAN: Learning Compact Binary Descriptors with a Regularized GAN

In this paper, we propose a novel regularization method for Generative A...
research
09/25/2019

Classification Logit Two-sample Testing by Neural Networks

The recent success of generative adversarial networks and variational le...
research
05/17/2021

Data Assimilation Predictive GAN (DA-PredGAN): applied to determine the spread of COVID-19

We propose the novel use of a generative adversarial network (GAN) (i) t...
research
03/22/2013

Sparse Projections of Medical Images onto Manifolds

Manifold learning has been successfully applied to a variety of medical ...

Please sign up or login with your details

Forgot password? Click here to reset