Positive Pair Distillation Considered Harmful: Continual Meta Metric Learning for Lifelong Object Re-Identification

10/04/2022
by   Kai Wang, et al.
0

Lifelong object re-identification incrementally learns from a stream of re-identification tasks. The objective is to learn a representation that can be applied to all tasks and that generalizes to previously unseen re-identification tasks. The main challenge is that at inference time the representation must generalize to previously unseen identities. To address this problem, we apply continual meta metric learning to lifelong object re-identification. To prevent forgetting of previous tasks, we use knowledge distillation and explore the roles of positive and negative pairs. Based on our observation that the distillation and metric losses are antagonistic, we propose to remove positive pairs from distillation to robustify model updates. Our method, called Distillation without Positive Pairs (DwoPP), is evaluated on extensive intra-domain experiments on person and vehicle re-identification datasets, as well as inter-domain experiments on the LReID benchmark. Our experiments demonstrate that DwoPP significantly outperforms the state-of-the-art. The code is here: https://github.com/wangkai930418/DwoPP_code

READ FULL TEXT

page 1

page 2

page 18

research
05/11/2022

Contrastive Supervised Distillation for Continual Representation Learning

In this paper, we propose a novel training procedure for the continual r...
research
06/08/2020

Continual Representation Learning for Biometric Identification

With the explosion of digital data in recent years, continuously learnin...
research
06/17/2022

Improving Generalization of Metric Learning via Listwise Self-distillation

Most deep metric learning (DML) methods employ a strategy that forces al...
research
03/10/2022

Representation Compensation Networks for Continual Semantic Segmentation

In this work, we study the continual semantic segmentation problem, wher...
research
07/08/2018

Revisiting Distillation and Incremental Classifier Learning

One of the key differences between the learning mechanism of humans and ...
research
05/17/2022

Region-Aware Metric Learning for Open World Semantic Segmentation via Meta-Channel Aggregation

As one of the most challenging and practical segmentation tasks, open-wo...
research
07/06/2021

CoReD: Generalizing Fake Media Detection with Continual Representation using Distillation

Over the last few decades, artificial intelligence research has made tre...

Please sign up or login with your details

Forgot password? Click here to reset