Density Map Distillation for Incremental Object Counting

04/11/2023
by   Chenshen Wu, et al.
0

We investigate the problem of incremental learning for object counting, where a method must learn to count a variety of object classes from a sequence of datasets. A naïve approach to incremental object counting would suffer from catastrophic forgetting, where it would suffer from a dramatic performance drop on previous tasks. In this paper, we propose a new exemplar-free functional regularization method, called Density Map Distillation (DMD). During training, we introduce a new counter head for each task and introduce a distillation loss to prevent forgetting of previous tasks. Additionally, we introduce a cross-task adaptor that projects the features of the current backbone to the previous backbone. This projector allows for the learning of new features while the backbone retains the relevant features for previous tasks. Finally, we set up experiments of incremental learning for counting new objects. Results confirm that our method greatly reduces catastrophic forgetting and outperforms existing methods.

READ FULL TEXT

page 2

page 5

research
07/27/2020

Two-Level Residual Distillation based Triple Network for Incremental Object Detection

Modern object detection methods based on convolutional neural network su...
research
04/01/2020

Semantic Drift Compensation for Class-Incremental Learning

Class-incremental learning of deep networks sequentially increases the n...
research
05/06/2022

Forget Less, Count Better: A Domain-Incremental Self-Distillation Learning Benchmark for Lifelong Crowd Counting

Crowd Counting has important applications in public safety and pandemic ...
research
12/16/2022

MEIL-NeRF: Memory-Efficient Incremental Learning of Neural Radiance Fields

Hinged on the representation power of neural networks, neural radiance f...
research
04/02/2022

Class-Incremental Learning by Knowledge Distillation with Adaptive Feature Consolidation

We present a novel class incremental learning approach based on deep neu...
research
07/23/2023

Augmented Box Replay: Overcoming Foreground Shift for Incremental Object Detection

In incremental learning, replaying stored samples from previous tasks to...
research
04/10/2022

FOSTER: Feature Boosting and Compression for Class-Incremental Learning

The ability to learn new concepts continually is necessary in this ever-...

Please sign up or login with your details

Forgot password? Click here to reset