DeepAI AI Chat
Log In Sign Up

IIRC: Incremental Implicitly-Refined Classification

12/23/2020
by   Mohamed Abdelsalam, et al.
7

We introduce the "Incremental Implicitly-Refined Classi-fication (IIRC)" setup, an extension to the class incremental learning setup where the incoming batches of classes have two granularity levels. i.e., each sample could have a high-level (coarse) label like "bear" and a low-level (fine) label like "polar bear". Only one label is provided at a time, and the model has to figure out the other label if it has already learnfed it. This setup is more aligned with real-life scenarios, where a learner usually interacts with the same family of entities multiple times, discovers more granularity about them, while still trying not to forget previous knowledge. Moreover, this setup enables evaluating models for some important lifelong learning challenges that cannot be easily addressed under the existing setups. These challenges can be motivated by the example "if a model was trained on the class bear in one task and on polar bear in another task, will it forget the concept of bear, will it rightfully infer that a polar bear is still a bear? and will it wrongfully associate the label of polar bear to other breeds of bear?". We develop a standardized benchmark that enables evaluating models on the IIRC setup. We evaluate several state-of-the-art lifelong learning algorithms and highlight their strengths and limitations. For example, distillation-based methods perform relatively well but are prone to incorrectly predicting too many labels per image. We hope that the proposed setup, along with the benchmark, would provide a meaningful problem setting to the practitioners

READ FULL TEXT

page 8

page 15

page 16

page 17

page 18

page 19

page 20

02/23/2022

Multi-Teacher Knowledge Distillation for Incremental Implicitly-Refined Classification

Incremental learning methods can learn new classes continually by distil...
10/21/2021

HCV: Hierarchy-Consistency Verification for Incremental Implicitly-Refined Classification

Human beings learn and accumulate hierarchical knowledge over their life...
07/20/2022

On Label Granularity and Object Localization

Weakly supervised object localization (WSOL) aims to learn representatio...
02/01/2023

Towards Label-Efficient Incremental Learning: A Survey

The current dominant paradigm when building a machine learning model is ...
12/10/2021

From Modular Decomposition Trees to Level-1 Networks: Pseudo-Cographs, Polar-Cats and Prime Polar-Cats

We characterize graphs G that can be explained by rooted labeled level-1...
03/11/2022

Deep Class Incremental Learning from Decentralized Data

In this paper, we focus on a new and challenging decentralized machine l...

Code Repositories

IIRC

IIRC: Incremental Implicitly Refined Classification


view repo