Class-incremental Novel Class Discovery

07/18/2022
by   Subhankar Roy, et al.
14

We study the new task of class-incremental Novel Class Discovery (class-iNCD), which refers to the problem of discovering novel categories in an unlabelled data set by leveraging a pre-trained model that has been trained on a labelled data set containing disjoint yet related categories. Apart from discovering novel classes, we also aim at preserving the ability of the model to recognize previously seen base categories. Inspired by rehearsal-based incremental learning methods, in this paper we propose a novel approach for class-iNCD which prevents forgetting of past information about the base classes by jointly exploiting base class feature prototypes and feature-level knowledge distillation. We also propose a self-training clustering strategy that simultaneously clusters novel categories and trains a joint classifier for both the base and novel classes. This makes our method able to operate in a class-incremental setting. Our experiments, conducted on three common benchmarks, demonstrate that our method significantly outperforms state-of-the-art approaches. Code is available at https://github.com/OatmealLiu/class-iNCD

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/07/2022

Class-Incremental Learning with Strong Pre-trained Models

Class-incremental learning (CIL) has been widely studied under the setti...
research
10/05/2022

Multi-stream Fusion for Class Incremental Learning in Pill Image Classification

Classifying pill categories from real-world images is crucial for variou...
research
11/20/2018

Learning without Memorizing

Incremental learning (IL) is an important task aimed to increase the cap...
research
07/18/2023

Class-relation Knowledge Distillation for Novel Class Discovery

We tackle the problem of novel class discovery, which aims to learn nove...
research
02/06/2023

Neural Collapse Inspired Feature-Classifier Alignment for Few-Shot Class Incremental Learning

Few-shot class-incremental learning (FSCIL) has been a challenging probl...
research
07/21/2022

Novel Class Discovery without Forgetting

Humans possess an innate ability to identify and differentiate instances...
research
03/28/2023

Large-scale Pre-trained Models are Surprisingly Strong in Incremental Novel Class Discovery

Discovering novel concepts from unlabelled data and in a continuous mann...

Please sign up or login with your details

Forgot password? Click here to reset