Demonstrating the Evolution of GANs through t-SNE

01/31/2021
by   Victor Costa, et al.
0

Generative Adversarial Networks (GANs) are powerful generative models that achieved strong results, mainly in the image domain. However, the training of GANs is not trivial, presenting some challenges tackled by different strategies. Evolutionary algorithms, such as COEGAN, were recently proposed as a solution to improve the GAN training, overcoming common problems that affect the model, such as vanishing gradient and mode collapse. In this work, we propose an evaluation method based on t-distributed Stochastic Neighbour Embedding (t-SNE) to assess the progress of GANs and visualize the distribution learned by generators in training. We propose the use of the feature space extracted from trained discriminators to evaluate samples produced by generators and from the input dataset. A metric based on the resulting t-SNE maps and the Jaccard index is proposed to represent the model quality. Experiments were conducted to assess the progress of GANs when trained using COEGAN. The results show both by visual inspection and metrics that the Evolutionary Algorithm gradually improves discriminators and generators through generations, avoiding problems such as mode collapse.

READ FULL TEXT

page 12

page 13

06/25/2021

Fostering Diversity in Spatial Evolutionary Generative Adversarial Networks

Generative adversary networks (GANs) suffer from training pathologies su...
08/21/2020

CDE-GAN: Cooperative Dual Evolution Based Generative Adversarial Network

Generative adversarial networks (GANs) have been a popular deep generati...
07/13/2020

Exploring the Evolution of GANs through Quality Diversity

Generative adversarial networks (GANs) achieved relevant advances in the...
04/09/2020

Using Skill Rating as Fitness on the Evolution of GANs

Generative Adversarial Networks (GANs) are an adversarial model that ach...
06/03/2018

Disconnected Manifold Learning for Generative Adversarial Networks

Real images often lie on a union of disjoint manifolds rather than one g...
03/30/2020

Re-purposing Heterogeneous Generative Ensembles with Evolutionary Computation

Generative Adversarial Networks (GANs) are popular tools for generative ...
01/23/2019

Composition and decomposition of GANs

In this work, we propose a composition/decomposition framework for adver...