Adversarial Text-to-Image Synthesis: A Review

01/25/2021
by   Stanislav Frolov, et al.
27

With the advent of generative adversarial networks, synthesizing images from textual descriptions has recently become an active research area. It is a flexible and intuitive way for conditional image generation with significant progress in the last years regarding visual realism, diversity, and semantic alignment. However, the field still faces several challenges that require further research efforts such as enabling the generation of high-resolution images with multiple objects, and developing suitable and reliable evaluation metrics that correlate with human judgement. In this review, we contextualize the state of the art of adversarial text-to-image synthesis models, their development since their inception five years ago, and propose a taxonomy based on the level of supervision. We critically examine current strategies to evaluate text-to-image synthesis models, highlight shortcomings, and identify new areas of research, ranging from the development of better datasets and evaluation metrics to possible improvements in architectural design and model training. This review complements previous surveys on generative adversarial networks with a focus on text-to-image synthesis which we believe will help researchers to further advance the field.

READ FULL TEXT

page 4

page 12

page 13

research
06/30/2021

A Survey on Adversarial Image Synthesis

Generative Adversarial Networks (GANs) have been extremely successful in...
research
03/12/2018

An Introduction to Image Synthesis with Generative Adversarial Nets

There has been a drastic growth of research in Generative Adversarial Ne...
research
10/21/2019

A Survey and Taxonomy of Adversarial Neural Networks for Text-to-Image Synthesis

Text-to-image synthesis refers to computational methods which translate ...
research
07/09/2021

Deep Image Synthesis from Intuitive User Input: A Review and Perspectives

In many applications of computer graphics, art and design, it is desirab...
research
10/29/2019

The Six Fronts of the Generative Adversarial Networks

Generative Adversarial Networks fostered a newfound interest in generati...
research
12/27/2021

Multimodal Image Synthesis and Editing: A Survey

As information exists in various modalities in real world, effective int...
research
03/24/2023

Factor Decomposed Generative Adversarial Networks for Text-to-Image Synthesis

Prior works about text-to-image synthesis typically concatenated the sen...

Please sign up or login with your details

Forgot password? Click here to reset