Demonstrating the Evolution of GANs through t-SNE

by   Victor Costa, et al.

Generative Adversarial Networks (GANs) are powerful generative models that achieved strong results, mainly in the image domain. However, the training of GANs is not trivial, presenting some challenges tackled by different strategies. Evolutionary algorithms, such as COEGAN, were recently proposed as a solution to improve the GAN training, overcoming common problems that affect the model, such as vanishing gradient and mode collapse. In this work, we propose an evaluation method based on t-distributed Stochastic Neighbour Embedding (t-SNE) to assess the progress of GANs and visualize the distribution learned by generators in training. We propose the use of the feature space extracted from trained discriminators to evaluate samples produced by generators and from the input dataset. A metric based on the resulting t-SNE maps and the Jaccard index is proposed to represent the model quality. Experiments were conducted to assess the progress of GANs when trained using COEGAN. The results show both by visual inspection and metrics that the Evolutionary Algorithm gradually improves discriminators and generators through generations, avoiding problems such as mode collapse.


page 12

page 13


Fostering Diversity in Spatial Evolutionary Generative Adversarial Networks

Generative adversary networks (GANs) suffer from training pathologies su...

CDE-GAN: Cooperative Dual Evolution Based Generative Adversarial Network

Generative adversarial networks (GANs) have been a popular deep generati...

Exploring the Evolution of GANs through Quality Diversity

Generative adversarial networks (GANs) achieved relevant advances in the...

Using Skill Rating as Fitness on the Evolution of GANs

Generative Adversarial Networks (GANs) are an adversarial model that ach...

Disconnected Manifold Learning for Generative Adversarial Networks

Real images often lie on a union of disjoint manifolds rather than one g...

Re-purposing Heterogeneous Generative Ensembles with Evolutionary Computation

Generative Adversarial Networks (GANs) are popular tools for generative ...

Composition and decomposition of GANs

In this work, we propose a composition/decomposition framework for adver...