Disentangled Makeup Transfer with Generative Adversarial Network

07/02/2019
by   Honglun Zhang, et al.
3

Facial makeup transfer is a widely-used technology that aims to transfer the makeup style from a reference face image to a non-makeup face. Existing literature leverage the adversarial loss so that the generated faces are of high quality and realistic as real ones, but are only able to produce fixed outputs. Inspired by recent advances in disentangled representation, in this paper we propose DMT (Disentangled Makeup Transfer), a unified generative adversarial network to achieve different scenarios of makeup transfer. Our model contains an identity encoder as well as a makeup encoder to disentangle the personal identity and the makeup style for arbitrary face images. Based on the outputs of the two encoders, a decoder is employed to reconstruct the original faces. We also apply a discriminator to distinguish real faces from fake ones. As a result, our model can not only transfer the makeup styles from one or more reference face images to a non-makeup face with controllable strength, but also produce various outputs with styles sampled from a prior distribution. Extensive experiments demonstrate that our model is superior to existing literature by generating high-quality results for different scenarios of makeup transfer.

READ FULL TEXT

page 2

page 3

page 4

page 6

page 7

page 8

page 9

page 10

research
03/27/2020

Local Facial Makeup Transfer via Disentangled Representation

Facial makeup transfer aims to render a non-makeup face image in an arbi...
research
05/31/2017

Representation Learning by Rotating Your Faces

The large pose discrepancy between two face images is one of the fundame...
research
04/09/2021

Multimodal Face Synthesis from Visual Attributes

Synthesis of face images from visual attributes is an important problem ...
research
03/24/2022

Learning Disentangled Representation for One-shot Progressive Face Swapping

Although face swapping has attracted much attention in recent years, it ...
research
12/08/2019

Face Beautification: Beyond Makeup Transfer

Facial appearance plays an important role in our social lives. Subjectiv...
research
04/25/2016

Makeup like a superstar: Deep Localized Makeup Transfer Network

In this paper, we propose a novel Deep Localized Makeup Transfer Network...
research
02/05/2018

Face Destylization

Numerous style transfer methods which produce artistic styles of portrai...

Please sign up or login with your details

Forgot password? Click here to reset