Few-Shot Continual Learning for Conditional Generative Adversarial Networks

05/19/2023
by   Cat P. Le, et al.
0

In few-shot continual learning for generative models, a target mode must be learned with limited samples without adversely affecting the previously learned modes. In this paper, we propose a new continual learning approach for conditional generative adversarial networks (cGAN) based on a new mode-affinity measure for generative modeling. Our measure is entirely based on the cGAN's discriminator and can identify the existing modes that are most similar to the target. Subsequently, we expand the continual learning model by including the target mode using a weighted label derived from those of the closest modes. To prevent catastrophic forgetting, we first generate labeled data samples using the cGAN's generator, and then train the cGAN model for the target mode while memory replaying with the generated data. Our experimental results demonstrate the efficacy of our approach in improving the generation performance over the baselines and the state-of-the-art approaches for various standard datasets while utilizing fewer training samples.

READ FULL TEXT

page 4

page 6

page 7

page 16

research
12/29/2021

Overcoming Mode Collapse with Adaptive Multi Adversarial Training

Generative Adversarial Networks (GANs) are a class of generative models ...
research
11/27/2018

Generative Adversarial Network Training is a Continual Learning Problem

Generative Adversarial Networks (GANs) have proven to be a powerful fram...
research
03/02/2022

Continual Learning of Multi-modal Dynamics with External Memory

We study the problem of fitting a model to a dynamical environment when ...
research
01/22/2021

Continual Learning of Generative Models with Limited Data: From Wasserstein-1 Barycenter to Adaptive Coalescence

Learning generative models is challenging for a network edge node with l...
research
01/17/2022

Logarithmic Continual Learning

We introduce a neural network architecture that logarithmically reduces ...
research
05/23/2017

Continual Learning in Generative Adversarial Nets

Developments in deep generative models have allowed for tractable learni...
research
03/06/2021

Efficient Continual Adaptation for Generative Adversarial Networks

We present a continual learning approach for generative adversarial netw...

Please sign up or login with your details

Forgot password? Click here to reset