One-Shot Generative Domain Adaptation

by   Ceyuan Yang, et al.

This work aims at transferring a Generative Adversarial Network (GAN) pre-trained on one image domain to a new domain referring to as few as just one target image. The main challenge is that, under limited supervision, it is extremely difficult to synthesize photo-realistic and highly diverse images, while acquiring representative characters of the target. Different from existing approaches that adopt the vanilla fine-tuning strategy, we import two lightweight modules to the generator and the discriminator respectively. Concretely, we introduce an attribute adaptor into the generator yet freeze its original parameters, through which it can reuse the prior knowledge to the most extent and hence maintain the synthesis quality and diversity. We then equip the well-learned discriminator backbone with an attribute classifier to ensure that the generator captures the appropriate characters from the reference. Furthermore, considering the poor diversity of the training data (i.e., as few as only one image), we propose to also constrain the diversity of the generative domain in the training process, alleviating the optimization difficulty. Our approach brings appealing results under various settings, substantially surpassing state-of-the-art alternatives, especially in terms of synthesis diversity. Noticeably, our method works well even with large domain gaps, and robustly converges within a few minutes for each experiment.


page 6

page 7

page 9

page 17

page 18

page 19

page 20

page 21


Towards Diverse and Faithful One-shot Adaption of Generative Adversarial Networks

One-shot generative domain adaption aims to transfer a pre-trained gener...

Image Generation from Small Datasets via Batch Statistics Adaptation

Thanks to the recent development of deep generative models, it is becomi...

Mind the Gap: Domain Gap Control for Single Shot Domain Adaptation for Generative Adversarial Networks

We present a new method for one shot domain adaptation. The input to our...

One-Shot Adaptation of GAN in Just One CLIP

There are many recent research efforts to fine-tune a pre-trained genera...

DATID-3D: Diversity-Preserved Domain Adaptation Using Text-to-Image Diffusion for 3D Generative Model

Recent 3D generative models have achieved remarkable performance in synt...

Group Equivariant Generative Adversarial Networks

Generative adversarial networks are the state of the art for generative ...

Code Repositories


[ArXiv 2021] One-Shot Generative Domain Adaptation

view repo

Please sign up or login with your details

Forgot password? Click here to reset