CA-GAN: Weakly Supervised Color Aware GAN for Controllable Makeup Transfer

08/24/2020
by   Robin Kips, et al.
8

While existing makeup style transfer models perform an image synthesis whose results cannot be explicitly controlled, the ability to modify makeup color continuously is a desirable property for virtual try-on applications. We propose a new formulation for the makeup style transfer task, with the objective to learn a color controllable makeup style synthesis. We introduce CA-GAN, a generative model that learns to modify the color of specific objects (e.g. lips or eyes) in the image to an arbitrary target color while preserving background. Since color labels are rare and costly to acquire, our method leverages weakly supervised learning for conditional GANs. This enables to learn a controllable synthesis of complex objects, and only requires a weak proxy of the image attribute that we desire to modify. Finally, we present for the first time a quantitative analysis of makeup style transfer and color control performance.

READ FULL TEXT

page 1

page 6

page 9

page 10

page 11

page 14

research
08/15/2023

StyleDiffusion: Controllable Disentangled Style Transfer via Diffusion Models

Content and style (C-S) disentanglement is a fundamental problem and cri...
research
05/03/2019

Controllable Artistic Text Style Transfer via Shape-Matching GAN

Artistic text style transfer is the task of migrating the style from a s...
research
02/16/2023

3D-aware Conditional Image Synthesis

We propose pix2pix3D, a 3D-aware conditional generative model for contro...
research
10/20/2022

PalGAN: Image Colorization with Palette Generative Adversarial Networks

Multimodal ambiguity and color bleeding remain challenging in colorizati...
research
10/23/2017

Neural Stain-Style Transfer Learning using GAN for Histopathological Images

Performance of data-driven network for tumor classification varies with ...
research
02/20/2018

Stroke Controllable Fast Style Transfer with Adaptive Receptive Fields

Recently, in the community of Neural Style Transfer, several algorithms ...
research
08/01/2022

Cross Attention Based Style Distribution for Controllable Person Image Synthesis

Controllable person image synthesis task enables a wide range of applica...

Please sign up or login with your details

Forgot password? Click here to reset