Fine-Tuning StyleGAN2 For Cartoon Face Generation

06/22/2021
by   Jihye Back, et al.
0

Recent studies have shown remarkable success in the unsupervised image to image (I2I) translation. However, due to the imbalance in the data, learning joint distribution for various domains is still very challenging. Although existing models can generate realistic target images, it's difficult to maintain the structure of the source image. In addition, training a generative model on large data in multiple domains requires a lot of time and computer resources. To address these limitations, we propose a novel image-to-image translation method that generates images of the target domain by finetuning a stylegan2 pretrained model. The stylegan2 model is suitable for unsupervised I2I translation on unbalanced datasets; it is highly stable, produces realistic images, and even learns properly from limited data when applied with simple fine-tuning techniques. Thus, in this paper, we propose new methods to preserve the structure of the source images and generate realistic images in the target domain. The code and results are available at https://github.com/happy-jihye/Cartoon-StyleGan2

READ FULL TEXT

page 2

page 3

page 5

page 6

page 7

page 9

page 10

research
04/12/2018

Multimodal Unsupervised Image-to-Image Translation

Unsupervised image-to-image translation is an important and challenging ...
research
05/13/2021

TransferI2I: Transfer Learning for Image-to-Image Translation from Small Datasets

Image-to-image (I2I) translation has matured in recent years and is able...
research
03/17/2023

MODIFY: Model-driven Face Stylization without Style Images

Existing face stylization methods always acquire the presence of the tar...
research
11/29/2022

Taming a Generative Model

Generative models are becoming ever more powerful, being able to synthes...
research
07/04/2023

Consistent Multimodal Generation via A Unified GAN Framework

We investigate how to generate multimodal image outputs, such as RGB, de...
research
04/07/2021

DG-Font: Deformable Generative Networks for Unsupervised Font Generation

Font generation is a challenging problem especially for some writing sys...
research
03/07/2023

Generative Modeling with Flow-Guided Density Ratio Learning

We present Flow-Guided Density Ratio Learning (FDRL), a simple and scala...

Please sign up or login with your details

Forgot password? Click here to reset