DeepAI AI Chat
Log In Sign Up

Multi-Attributed and Structured Text-to-Face Synthesis

by   Rohan Wadhawan, et al.

Generative Adversarial Networks (GANs) have revolutionized image synthesis through many applications like face generation, photograph editing, and image super-resolution. Image synthesis using GANs has predominantly been uni-modal, with few approaches that can synthesize images from text or other data modes. Text-to-image synthesis, especially text-to-face synthesis, has promising use cases of robust face-generation from eye witness accounts and augmentation of the reading experience with visual cues. However, only a couple of datasets provide consolidated face data and textual descriptions for text-to-face synthesis. Moreover, these textual annotations are less extensive and descriptive, which reduces the diversity of faces generated from it. This paper empirically proves that increasing the number of facial attributes in each textual description helps GANs generate more diverse and real-looking faces. To prove this, we propose a new methodology that focuses on using structured textual descriptions. We also consolidate a Multi-Attributed and Structured Text-to-face (MAST) dataset consisting of high-quality images with structured textual annotations and make it available to researchers to experiment and build upon. Lastly, we report benchmark Frechet's Inception Distance (FID), Facial Semantic Similarity (FSS), and Facial Semantic Distance (FSD) scores for the MAST dataset.


page 1

page 4

page 6

page 7


StyleT2F: Generating Human Faces from Textual Description Using StyleGAN2

AI-driven image generation has improved significantly in recent years. G...

Faces à la Carte: Text-to-Face Generation via Attribute Disentanglement

Text-to-Face (TTF) synthesis is a challenging task with great potential ...

FTGAN: A Fully-trained Generative Adversarial Networks for Text to Face Generation

As a sub-domain of text-to-image synthesis, text-to-face generation has ...

Text-to-Face Generation with StyleGAN2

Synthesizing images from text descriptions has become an active research...

Semantic Text-to-Face GAN -ST^2FG

Faces generated using generative adversarial networks (GANs) have reache...

AnyFace: Free-style Text-to-Face Synthesis and Manipulation

Existing text-to-image synthesis methods generally are only applicable t...

MemeFaceGenerator: Adversarial Synthesis of Chinese Meme-face from Natural Sentences

Chinese meme-face is a special kind of internet subculture widely spread...