DeepAI AI Chat
Log In Sign Up

Few Shot Generative Model Adaption via Relaxed Spatial Structural Alignment

by   Jiayu Xiao, et al.
University of the Chinese Academy of Sciences
Tsinghua University
Institute of Computing Technology, Chinese Academy of Sciences

Training a generative adversarial network (GAN) with limited data has been a challenging task. A feasible solution is to start with a GAN well-trained on a large scale source domain and adapt it to the target domain with a few samples, termed as few shot generative model adaption. However, existing methods are prone to model overfitting and collapse in extremely few shot setting (less than 10). To solve this problem, we propose a relaxed spatial structural alignment method to calibrate the target generative models during the adaption. We design a cross-domain spatial structural consistency loss comprising the self-correlation and disturbance correlation consistency loss. It helps align the spatial structural information between the synthesis image pairs of the source and target domains. To relax the cross-domain alignment, we compress the original latent space of generative models to a subspace. Image pairs generated from the subspace are pulled closer. Qualitative and quantitative experiments show that our method consistently surpasses the state-of-the-art methods in few shot setting.


page 1

page 3

page 5

page 6

page 7

page 8


Few-shot Image Generation via Cross-domain Correspondence

Training generative models, such as GANs, on a target domain containing ...

Domain Adaptation for Learning Generator from Paired Few-Shot Data

We propose a Paired Few-shot GAN (PFS-GAN) model for learning generators...

Adaptive Semantic Consistency for Cross-domain Few-shot Classification

Cross-domain few-shot classification (CD-FSC) aims to identify novel tar...

AlignGAN: Learning to Align Cross-Domain Images with Conditional Generative Adversarial Networks

Recently, several methods based on generative adversarial network (GAN) ...

Structural Cycle GAN for Virtual Immunohistochemistry Staining of Gland Markers in the Colon

With the advent of digital scanners and deep learning, diagnostic operat...

Pixel-by-Pixel Cross-Domain Alignment for Few-Shot Semantic Segmentation

In this paper we consider the task of semantic segmentation in autonomou...

Robust Cross-domain CT Image Reconstruction via Bayesian Noise Uncertainty Alignment

In this work, we tackle the problem of robust computed tomography (CT) r...