PSGAN: Pose-Robust Spatial-Aware GAN for Customizable Makeup Transfer

09/16/2019
by   Wentao Jiang, et al.
National University of Singapore
iie.ac.cn
Beihang University
YITUTech
ia.ac.cn
23

We propose a novel Pose-robust Spatial-aware GAN (PSGAN) for transferring the makeup style from a reference image to a source image. Previous GAN-based methods often fail in cases with variant poses and expressions. Also, they cannot adjust the shade of makeup or specify the part of transfer. To address these issues, the proposed PSGAN includes a Makeup Distillation Network to distill the makeup style of the reference image into two spatial-aware makeup matrices. Then an Attentive Makeup Morphing module is introduced to specify how a pixel in the source image is morphed from the reference image. The pixelwise correspondence is built upon both the relative position features and visual features. Based on the morphed makeup matrices, a De-makeup Re-makeup Network performs makeup transfer. By incorporating the above novelties, our PSGAN not only achieves state-of-the-art results on the existing datasets, but also is able to perform the customizable part-by-part, shade controllable and pose-robust makeup transfer.

READ FULL TEXT

page 1

page 3

page 5

page 6

page 7

05/26/2021

PSGAN++: Robust Detail-Preserving Makeup Transfer and Removal

In this paper, we address the makeup transfer and removal tasks simultan...
04/21/2021

SOGAN: 3D-Aware Shadow and Occlusion Robust GAN for Makeup Transfer

In recent years, virtual makeup applications have become more and more p...
12/01/2021

FDA-GAN: Flow-based Dual Attention GAN for Human Pose Transfer

Human pose transfer aims at transferring the appearance of the source pe...
12/07/2021

SSAT: A Symmetric Semantic-Aware Transformer Network for Makeup Transfer and Removal

Makeup transfer is not only to extract the makeup style of the reference...
06/17/2022

HairFIT: Pose-Invariant Hairstyle Transfer via Flow-based Hair Alignment and Semantic-Region-Aware Inpainting

Hairstyle transfer is the task of modifying a source hairstyle to a targ...
03/04/2022

Semi-parametric Makeup Transfer via Semantic-aware Correspondence

The large discrepancy between the source non-makeup image and the refere...
09/29/2021

Detailed Region-Adaptive Normalization for Heavy Makeup Transfer

In recent years, facial makeup transfer has attracted growing attention ...

Code Repositories

PSGAN

PyTorch code for "PSGAN: Pose and Expression Robust Spatial-Aware GAN for Customizable Makeup Transfer" (CVPR 2020 Oral)


view repo

PSGAN-PyTorch

PyTorch implementation of PSGAN: Pose and Expression Robust Spatial-Aware GAN for Customizable Makeup Transfer


view repo

Please sign up or login with your details

Forgot password? Click here to reset