FA-GAN: Feature-Aware GAN for Text to Image Synthesis

09/02/2021
by   Eunyeong Jeon, et al.
0

Text-to-image synthesis aims to generate a photo-realistic image from a given natural language description. Previous works have made significant progress with Generative Adversarial Networks (GANs). Nonetheless, it is still hard to generate intact objects or clear textures (Fig 1). To address this issue, we propose Feature-Aware Generative Adversarial Network (FA-GAN) to synthesize a high-quality image by integrating two techniques: a self-supervised discriminator and a feature-aware loss. First, we design a self-supervised discriminator with an auxiliary decoder so that the discriminator can extract better representation. Secondly, we introduce a feature-aware loss to provide the generator more direct supervision by employing the feature representation from the self-supervised discriminator. Experiments on the MS-COCO dataset show that our proposed method significantly advances the state-of-the-art FID score from 28.92 to 24.58.

READ FULL TEXT

page 1

page 4

research
06/16/2021

Self-supervised GANs with Label Augmentation

Recently, transformation-based self-supervised learning has been applied...
research
05/12/2021

Label Geometry Aware Discriminator for Conditional Generative Networks

Multi-domain image-to-image translation with conditional Generative Adve...
research
11/21/2018

Unsupervised Single Image Deraining with Self-supervised Constraints

Most existing single image deraining methods require learning supervised...
research
06/15/2020

DeshuffleGAN: A Self-Supervised GAN to Improve Structure Learning

Generative Adversarial Networks (GANs) triggered an increased interest i...
research
01/19/2021

JigsawGAN: Self-supervised Learning for Solving Jigsaw Puzzles with Generative Adversarial Networks

The paper proposes a solution based on Generative Adversarial Network (G...
research
10/12/2022

FCT-GAN: Enhancing Table Synthesis via Fourier Transform

Synthetic tabular data emerges as an alternative for sharing knowledge w...
research
09/07/2023

Exploring Sparse MoE in GANs for Text-conditioned Image Synthesis

Due to the difficulty in scaling up, generative adversarial networks (GA...

Please sign up or login with your details

Forgot password? Click here to reset