Offline-Online Class-incremental Continual Learning via Dual-prototype Self-augment and Refinement

03/20/2023
by   Fushuo Huo, et al.
0

This paper investigates a new, practical, but challenging problem named Offline-Online Class-incremental Continual Learning (O^2CL), which aims to preserve the discernibility of pre-trained (i.e., offline) base classes without buffering data examples, and efficiently learn novel classes continuously in a single-pass (i.e., online) data stream. The challenges of this task are mainly two-fold: 1) Both base and novel classes suffer from severe catastrophic forgetting as no previous samples are available for replay. 2) As the online data can only be observed once, there is no way to fully re-train the whole model, e.g., re-calibrate the decision boundaries via prototype alignment or feature distillation. In this paper, we propose a novel Dual-prototype Self-augment and Refinement method (DSR) for O^2CL problem, which consists of two strategies: 1) Dual class prototypes: Inner and hyper-dimensional prototypes are exploited to utilize the pre-trained information and obtain robust quasi-orthogonal representations rather than example buffers for both privacy preservation and memory reduction. 2) Self-augment and refinement: Instead of updating the whole network, we jointly optimize the extra projection module with the self-augment inner prototypes from base and novel classes, gradually refining the hyper-dimensional prototypes to obtain accurate decision boundaries for learned classes. Extensive experiments demonstrate the effectiveness and superiority of the proposed DSR in O^2CL.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/24/2023

Dealing with Cross-Task Class Discrimination in Online Continual Learning

Existing continual learning (CL) research regards catastrophic forgettin...
research
08/01/2023

Online Prototype Learning for Online Continual Learning

Online continual learning (CL) studies the problem of learning continuou...
research
05/19/2022

Bypassing Logits Bias in Online Class-Incremental Learning with a Generative Framework

Continual learning requires the model to maintain the learned knowledge ...
research
07/19/2021

Self-Promoted Prototype Refinement for Few-Shot Class-Incremental Learning

Few-shot class-incremental learning is to recognize the new classes give...
research
03/26/2023

Prototype-Sample Relation Distillation: Towards Replay-Free Continual Learning

In Continual learning (CL) balancing effective adaptation while combatin...
research
06/22/2023

Class-Incremental Learning based on Label Generation

Despite the great success of pre-trained language models, it is still a ...

Please sign up or login with your details

Forgot password? Click here to reset