Translate the Facial Regions You Like Using Region-Wise Normalization

07/29/2020
by   Wenshuang Liu, et al.
0

Though GAN (Generative Adversarial Networks) based technique has greatly advanced the performance of image synthesis and face translation, only few works available in literature provide region based style encoding and translation. We propose in this paper a region-wise normalization framework, for region level face translation. While per-region style is encoded using available approach, we build a so called RIN (region-wise normalization) block to individually inject the styles into per-region feature maps and then fuse them for following convolution and upsampling. Both shape and texture of different regions can thus be translated to various target styles. A region matching loss has also been proposed to significantly reduce the inference between regions during the translation process. Extensive experiments on three publicly available datasets, i.e. Morph, RaFD and CelebAMask-HQ, suggest that our approach demonstrate a large improvement over state-of-the-art methods like StarGAN, SEAN and FUNIT. Our approach has further advantages in precise control of the regions to be translated. As a result, region level expression changes and step by step make up can be achieved. The video demo is available at https://youtu.be/ceRqsbzXAfk.

READ FULL TEXT

page 2

page 3

page 6

page 7

page 8

page 11

page 12

page 13

11/28/2019

SEAN: Image Synthesis with Semantic Region-Adaptive Normalization

We propose semantic region-adaptive normalization (SEAN), a simple but e...
04/14/2021

Learning Semantic Person Image Generation by Region-Adaptive Normalization

Human pose transfer has received great attention due to its wide applica...
05/17/2021

Style-Restricted GAN: Multi-Modal Translation with Style Restriction Using Generative Adversarial Networks

Unpaired image-to-image translation using Generative Adversarial Network...
11/29/2019

Unpaired Image Translation via Adaptive Convolution-based Normalization

Disentangling content and style information of an image has played an im...
09/29/2021

Detailed Region-Adaptive Normalization for Heavy Makeup Transfer

In recent years, facial makeup transfer has attracted growing attention ...
12/27/2021

Self-normalized Classification of Parkinson's Disease DaTscan Images

Classifying SPECT images requires a preprocessing step which normalizes ...
03/31/2021

Semi-supervised Synthesis of High-Resolution Editable Textures for 3D Humans

We introduce a novel approach to generate diverse high fidelity texture ...