Collaborative Method for Incremental Learning on Classification and Generation

10/29/2020
by   Byungju Kim, et al.
0

Although well-trained deep neural networks have shown remarkable performance on numerous tasks, they rapidly forget what they have learned as soon as they begin to learn with additional data with the previous data stop being provided. In this paper, we introduce a novel algorithm, Incremental Class Learning with Attribute Sharing (ICLAS), for incremental class learning with deep neural networks. As one of its component, we also introduce a generative model, incGAN, which can generate images with increased variety compared with the training data. Under challenging environment of data deficiency, ICLAS incrementally trains classification and the generation networks. Since ICLAS trains both networks, our algorithm can perform multiple times of incremental class learning. The experiments on MNIST dataset demonstrate the advantages of our algorithm.

READ FULL TEXT
research
04/04/2019

Transfer Learning with Sparse Associative Memories

In this paper, we introduce a novel layer designed to be used as the out...
research
02/20/2018

Bayesian Incremental Learning for Deep Neural Networks

In industrial machine learning pipelines, data often arrive in parts. Pa...
research
11/09/2016

Incremental Sequence Learning

Deep learning research over the past years has shown that by increasing ...
research
04/30/2021

Eliminating Multicollinearity Issues in Neural Network Ensembles: Incremental, Negatively Correlated, Optimal Convex Blending

Given a features, target dataset, we introduce an incremental algorithm ...
research
12/12/2020

Learning Representations from Temporally Smooth Data

Events in the real world are correlated across nearby points in time, an...
research
05/30/2023

Prediction Error-based Classification for Class-Incremental Learning

Class-incremental learning (CIL) is a particularly challenging variant o...
research
10/04/2018

Transfer Incremental Learning using Data Augmentation

Deep learning-based methods have reached state of the art performances, ...

Please sign up or login with your details

Forgot password? Click here to reset