MODIFY: Model-driven Face Stylization without Style Images

03/17/2023
by   Yuhe Ding, et al.
0

Existing face stylization methods always acquire the presence of the target (style) domain during the translation process, which violates privacy regulations and limits their applicability in real-world systems. To address this issue, we propose a new method called MODel-drIven Face stYlization (MODIFY), which relies on the generative model to bypass the dependence of the target images. Briefly, MODIFY first trains a generative model in the target domain and then translates a source input to the target domain via the provided style model. To preserve the multimodal style information, MODIFY further introduces an additional remapping network, mapping a known continuous distribution into the encoder's embedding space. During translation in the source domain, MODIFY fine-tunes the encoder module within the target style-persevering model to capture the content of the source input as precisely as possible. Our method is extremely simple and satisfies versatile training modes for face stylization. Experimental results on several different datasets validate the effectiveness of MODIFY for unsupervised face stylization.

READ FULL TEXT

page 2

page 4

research
06/22/2021

Fine-Tuning StyleGAN2 For Cartoon Face Generation

Recent studies have shown remarkable success in the unsupervised image t...
research
02/11/2019

MISO: Mutual Information Loss with Stochastic Style Representations for Multimodal Image-to-Image Translation

Unpaired multimodal image-to-image translation is a task of translating ...
research
06/27/2021

Few-Shot Domain Expansion for Face Anti-Spoofing

Face anti-spoofing (FAS) is an indispensable and widely used module in f...
research
06/03/2018

NAM: Non-Adversarial Unsupervised Domain Mapping

Several methods were recently proposed for the task of translating image...
research
06/08/2023

Test-Time Style Shifting: Handling Arbitrary Styles in Domain Generalization

In domain generalization (DG), the target domain is unknown when the mod...
research
03/16/2021

Super-Resolving Cross-Domain Face Miniatures by Peeking at One-Shot Exemplar

Conventional face super-resolution methods usually assume testing low-re...
research
08/15/2018

Recycle-GAN: Unsupervised Video Retargeting

We introduce a data-driven approach for unsupervised video retargeting t...

Please sign up or login with your details

Forgot password? Click here to reset