Text to Image Synthesis Using Generative Adversarial Networks

05/02/2018
by   Cristian Bodnar, et al.
1

Generating images from natural language is one of the primary applications of recent conditional generative models. Besides testing our ability to model conditional, highly dimensional distributions, text to image synthesis has many exciting and practical applications such as photo editing or computer-aided content creation. Recent progress has been made using Generative Adversarial Networks (GANs). This material starts with a gentle introduction to these topics and discusses the existent state of the art models. Moreover, I propose Wasserstein GAN-CLS, a new model for conditional image generation based on the Wasserstein distance which offers guarantees of stability. Then, I show how the novel loss function of Wasserstein GAN-CLS can be used in a Conditional Progressive Growing GAN. In combination with the proposed loss, the model boosts by 7.07 models which use only the sentence-level visual semantics. The only model which performs better than the Conditional Wasserstein Progressive Growing GAN is the recently proposed AttnGAN which uses word-level visual semantics as well.

READ FULL TEXT
POST COMMENT

Comments

There are no comments yet.

Authors

page 24

page 27

page 28

page 29

page 34

page 35

page 39

page 40

10/02/2019

On the estimation of the Wasserstein distance in generative models

Generative Adversarial Networks (GANs) have been used to model the under...
08/06/2020

Generative Adversarial Networks for Image and Video Synthesis: Algorithms and Applications

The generative adversarial network (GAN) framework has emerged as a powe...
08/20/2020

Conditional Wasserstein GAN-based Oversampling of Tabular Data for Imbalanced Learning

Class imbalance is a common problem in supervised learning and impedes t...
10/04/2018

Towards High Resolution Video Generation with Progressive Growing of Sliced Wasserstein GANs

The extension of image generation to video generation turns out to be a ...
04/10/2019

Sliced Wasserstein Generative Models

In generative modeling, the Wasserstein distance (WD) has emerged as a u...
09/26/2019

Galaxy Image Simulation Using Progressive GANs

In this work, we provide an efficient and realistic data-driven approach...
02/22/2021

Anyone GAN Sing

The problem of audio synthesis has been increasingly solved using deep n...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.