Lifelong Twin Generative Adversarial Networks

07/09/2021
by   Fei Ye, et al.
0

In this paper, we propose a new continuously learning generative model, called the Lifelong Twin Generative Adversarial Networks (LT-GANs). LT-GANs learns a sequence of tasks from several databases and its architecture consists of three components: two identical generators, namely the Teacher and Assistant, and one Discriminator. In order to allow for the LT-GANs to learn new concepts without forgetting, we introduce a new lifelong training approach, namely Lifelong Adversarial Knowledge Distillation (LAKD), which encourages the Teacher and Assistant to alternately teach each other, while learning a new database. This training approach favours transferring knowledge from a more knowledgeable player to another player which knows less information about a previously given task.

READ FULL TEXT
research
11/05/2016

Generative Multi-Adversarial Networks

Generative adversarial networks (GANs) are a framework for producing a g...
research
12/10/2020

Slimmable Generative Adversarial Networks

Generative adversarial networks (GANs) have achieved remarkable progress...
research
07/14/2020

P-KDGAN: Progressive Knowledge Distillation with GANs for One-class Novelty Detection

One-class novelty detection is to identify anomalous instances that do n...
research
07/05/2021

On The Distribution of Penultimate Activations of Classification Networks

This paper studies probability distributions of penultimate activations ...
research
11/27/2016

Handwriting Profiling using Generative Adversarial Networks

Handwriting is a skill learned by humans from a very early age. The abil...
research
02/07/2018

Stochastic Deconvolutional Neural Network Ensemble Training on Generative Pseudo-Adversarial Networks

The training of Generative Adversarial Networks is a difficult task main...
research
02/02/2018

Incremental Classifier Learning with Generative Adversarial Networks

In this paper, we address the incremental classifier learning problem, w...

Please sign up or login with your details

Forgot password? Click here to reset