An Efficient Explorative Sampling Considering the Generative Boundaries of Deep Generative Neural Networks

12/12/2019
by   Giyoung Jeon, et al.
14

Deep generative neural networks (DGNNs) have achieved realistic and high-quality data generation. In particular, the adversarial training scheme has been applied to many DGNNs and has exhibited powerful performance. Despite of recent advances in generative networks, identifying the image generation mechanism still remains challenging. In this paper, we present an explorative sampling algorithm to analyze generation mechanism of DGNNs. Our method efficiently obtains samples with identical attributes from a query image in a perspective of the trained model. We define generative boundaries which determine the activation of nodes in the internal layer and probe inside the model with this information. To handle a large number of boundaries, we obtain the essential set of boundaries using optimization. By gathering samples within the region surrounded by generative boundaries, we can empirically reveal the characteristics of the internal layers of DGNNs. We also demonstrate that our algorithm can find more homogeneous, the model specific samples compared to the variations of ϵ-based sampling method.

READ FULL TEXT

page 2

page 4

page 6

page 7

research
03/09/2021

An Introduction to Deep Generative Modeling

Deep generative models (DGM) are neural networks with many hidden layers...
research
09/11/2020

Adversarial score matching and improved sampling for image generation

Denoising score matching with Annealed Langevin Sampling (DSM-ALS) is a ...
research
04/13/2021

Automatic Correction of Internal Units in Generative Neural Networks

Generative Adversarial Networks (GANs) have shown satisfactory performan...
research
07/11/2017

A step towards procedural terrain generation with GANs

Procedural terrain generation for video games has been traditionally bee...
research
12/16/2021

An Unsupervised Way to Understand Artifact Generating Internal Units in Generative Neural Networks

Despite significant improvements on the image generation performance of ...
research
03/01/2021

Federated Learning without Revealing the Decision Boundaries

We consider the recent privacy preserving methods that train the models ...
research
12/23/2015

A Deep Generative Deconvolutional Image Model

A deep generative model is developed for representation and analysis of ...

Please sign up or login with your details

Forgot password? Click here to reset