Generate the corresponding Image from Text Description using Modified GAN-CLS Algorithm

06/29/2018
by   Fuzhou Gong, et al.
4

Synthesizing images or texts automatically is a useful research area in the artificial intelligence nowadays. Generative adversarial networks (GANs), which are proposed by Goodfellow in 2014, make this task to be done more efficiently by using deep neural networks. We consider generating corresponding images from an input text description using a GAN. In this paper, we analyze the GAN-CLS algorithm, which is a kind of advanced method of GAN proposed by Scott Reed in 2016. First, we find the problem with this algorithm through inference. Then we correct the GAN-CLS algorithm according to the inference by modifying the objective function of the model. Finally, we do the experiments on the Oxford-102 dataset and the CUB dataset. As a result, our modified algorithm can generate images which are more plausible than the GAN-CLS algorithm in some cases. Also, some of the generated images match the input texts better.

READ FULL TEXT

page 7

page 8

page 9

page 10

page 11

page 12

page 13

page 14

research
06/08/2018

Generating Image Sequence from Description with LSTM Conditional GAN

Generating images from word descriptions is a challenging task. Generati...
research
07/07/2020

3D Topology Transformation with Generative Adversarial Networks

Generation and transformation of images and videos using artificial inte...
research
11/10/2020

Encoding large scale cosmological structure with Generative Adversarial Networks

Recently a type of neural networks called Generative Adversarial Network...
research
08/05/2023

Generative Adversarial Networks for Stain Normalisation in Histopathology

The rapid growth of digital pathology in recent years has provided an id...
research
10/10/2019

Visual Indeterminacy in GAN Art

This paper explores visual indeterminacy as a description for artwork cr...
research
03/06/2019

Conditional GANs For Painting Generation

We examined the use of modern Generative Adversarial Nets to generate no...
research
08/09/2021

GAN Computers Generate Arts? A Survey on Visual Arts, Music, and Literary Text Generation using Generative Adversarial Network

"Art is the lie that enables us to realize the truth." - Pablo Picasso. ...

Please sign up or login with your details

Forgot password? Click here to reset