US-GAN: On the importance of Ultimate Skip Connection for Facial Expression Synthesis

12/24/2021
by   Arbish Akram, et al.
11

Recent studies have shown impressive results in multi-domain image-to-image translation for facial expression synthesis. While effective, these methods require a large number of labelled samples for plausible results. Their performance significantly degrades when we train them on smaller datasets. To address this limitation, in this work, we present US-GAN, a smaller and effective method for synthesizing plausible expressions by employing notably smaller datasets. The proposed method comprises of encoding layers, single residual block, decoding layers and an ultimate skip connection that links the input image to an output image. It has three times lesser parameters as compared to state-of-the-art facial expression synthesis methods. Experimental results demonstrate the quantitative and qualitative effectiveness of our proposed method. In addition, we also show that an ultimate skip connection is sufficient for recovering rich facial and overall color details of the input face image that a larger state-of-the-art model fails to recover.

READ FULL TEXT

page 2

page 3

page 5

page 6

page 8

research
10/27/2020

Pixel-based Facial Expression Synthesis

Facial expression synthesis has achieved remarkable advances with the ad...
research
10/23/2019

Region Based Adversarial Synthesis of Facial Action Units

Facial expression synthesis or editing has recently received increasing ...
research
05/14/2019

Expression Conditional GAN for Facial Expression-to-Expression Translation

In this paper, we focus on the facial expression translation task and pr...
research
11/18/2020

Masked Linear Regression for Learning Local Receptive Fields for Facial Expression Synthesis

Compared to facial expression recognition, expression synthesis requires...
research
12/24/2018

Texture Deformation Based Generative Adversarial Networks for Face Editing

Despite the significant success in image-to-image translation and latent...
research
04/07/2020

Toward Fine-grained Facial Expression Manipulation

Facial expression manipulation, as an image-to-image translation problem...
research
10/22/2021

EvoGAN: An Evolutionary Computation Assisted GAN

The image synthesis technique is relatively well established which can g...

Please sign up or login with your details

Forgot password? Click here to reset