DeepAI AI Chat
Log In Sign Up

Adversarial Learning of Semantic Relevance in Text to Image Synthesis

by   Miriam Cha, et al.

We describe a new approach that improves the training of generative adversarial nets (GANs) for synthesizing diverse images from a text input. Our approach is based on the conditional version of GANs and expands on previous work leveraging an auxiliary task in the discriminator. Our generated images are not limited to certain classes and do not suffer from mode collapse while semantically matching the text input. A key to our training methods is how to form positive and negative training examples with respect to the class label of a given image. Instead of selecting random training examples, we perform negative sampling based on the semantic distance from a positive example in the class. We evaluate our approach using the Oxford-102 flower dataset, adopting the inception score and multi-scale structural similarity index (MS-SSIM) metrics to assess discriminability and diversity of the generated images. The empirical results indicate greater diversity in the generated images, especially when we gradually select more negative training examples closer to a positive example in the semantic space.


TAC-GAN - Text Conditioned Auxiliary Classifier Generative Adversarial Network

In this work, we present the Text Conditioned Auxiliary Classifier Gener...

Addressing the Fundamental Tension of PCGML with Discriminative Learning

Procedural content generation via machine learning (PCGML) is typically ...

A Self-attention Guided Multi-scale Gradient GAN for Diversified X-ray Image Synthesis

Imbalanced image datasets are commonly available in the domain of biomed...

DivCo: Diverse Conditional Image Synthesis via Contrastive Generative Adversarial Network

Conditional generative adversarial networks (cGANs) target at synthesizi...

Learning To Retrieve Prompts for In-Context Learning

In-context learning is a recent paradigm in natural language understandi...

MatchGAN: A Self-Supervised Semi-Supervised Conditional Generative Adversarial Network

We propose a novel self-supervised semi-supervised learning approach for...

Negative Sampling Improves Hypernymy Extraction Based on Projection Learning

We present a new approach to extraction of hypernyms based on projection...