Multimodal Face Synthesis from Visual Attributes

04/09/2021
by   Xing Di, et al.
4

Synthesis of face images from visual attributes is an important problem in computer vision and biometrics due to its applications in law enforcement and entertainment. Recent advances in deep generative networks have made it possible to synthesize high-quality face images from visual attributes. However, existing methods are specifically designed for generating unimodal images (i.e visible faces) from attributes. In this paper, we propose a novel generative adversarial network that simultaneously synthesizes identity preserving multimodal face images (i.e. visible, sketch, thermal, etc.) from visual attributes without requiring paired data in different domains for training the network. We introduce a novel generator with multimodal stretch-out modules to simultaneously synthesize multimodal face images. Additionally, multimodal stretch-in modules are introduced in the discriminator which discriminates between real and fake images. Extensive experiments and comparisons with several state-of-the-art methods are performed to verify the effectiveness of the proposed attribute-based multimodal synthesis method.

READ FULL TEXT
POST COMMENT

Comments

There are no comments yet.

Authors

page 3

page 5

page 7

page 8

page 9

page 10

page 11

page 12

12/17/2019

Facial Synthesis from Visual Attributes via Sketch using Multi-Scale Generators

Automatic synthesis of faces from visual attributes is an important prob...
10/04/2011

Discriminately Decreasing Discriminability with Learned Image Filters

In machine learning and computer vision, input images are often filtered...
06/09/2016

Convolutional Sketch Inversion

In this paper, we use deep neural networks for inverting face sketches t...
12/30/2017

Face Synthesis from Visual Attributes via Sketch using Conditional VAEs and GANs

Automatic synthesis of faces from visual attributes is an important prob...
10/26/2016

Mask-off: Synthesizing Face Images in the Presence of Head-mounted Displays

A head-mounted display (HMD) could be an important component of augmente...
02/09/2017

Attribute-controlled face photo synthesis from simple line drawing

Face photo synthesis from simple line drawing is a one-to-many task as s...
07/23/2018

Identity Preserving Face Completion for Large Ocular Region Occlusion

We present a novel deep learning approach to synthesize complete face im...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.