WeditGAN: Few-shot Image Generation via Latent Space Relocation

05/11/2023
by   Yuxuan Duan, et al.
0

In few-shot image generation, directly training GAN models on just a handful of images faces the risk of overfitting. A popular solution is to transfer the models pretrained on large source domains to small target ones. In this work, we introduce WeditGAN, which realizes model transfer by editing the intermediate latent codes w in StyleGANs with learned constant offsets (Δ w), discovering and constructing target latent spaces via simply relocating the distribution of source latent spaces. The established one-to-one mapping between latent spaces can naturally prevents mode collapse and overfitting. Besides, we also propose variants of WeditGAN to further enhance the relocation process by regularizing the direction or finetuning the intensity of Δ w. Experiments on a collection of widely used source/target datasets manifest the capability of WeditGAN in generating realistic and diverse images, which is simple yet highly effective in the research area of few-shot image generation.

READ FULL TEXT

page 1

page 6

page 8

page 11

page 12

page 13

page 15

page 16

research
04/13/2021

Few-shot Image Generation via Cross-domain Correspondence

Training generative models, such as GANs, on a target domain containing ...
research
05/12/2022

D3T-GAN: Data-Dependent Domain Transfer GANs for Few-shot Image Generation

As an important and challenging problem, few-shot image generation aims ...
research
12/05/2022

Audio Latent Space Cartography

We explore the generation of visualisations of audio latent spaces using...
research
03/16/2022

CtlGAN: Few-shot Artistic Portraits Generation with Contrastive Transfer Learning

Generating artistic portraits is a challenging problem in computer visio...
research
04/12/2023

NoisyTwins: Class-Consistent and Diverse Image Generation through StyleGANs

StyleGANs are at the forefront of controllable image generation as they ...
research
11/25/2020

Augmentation-Interpolative AutoEncoders for Unsupervised Few-Shot Image Generation

We aim to build image generation models that generalize to new domains f...
research
03/04/2023

Few-Shot Defect Image Generation via Defect-Aware Feature Manipulation

The performances of defect inspection have been severely hindered by ins...

Please sign up or login with your details

Forgot password? Click here to reset