CycAs: Self-supervised Cycle Association for Learning Re-identifiable Descriptions

07/15/2020
by   Zhongdao Wang, et al.
0

This paper proposes a self-supervised learning method for the person re-identification (re-ID) problem, where existing unsupervised methods usually rely on pseudo labels, such as those from video tracklets or clustering. A potential drawback of using pseudo labels is that errors may accumulate and it is challenging to estimate the number of pseudo IDs. We introduce a different unsupervised method that allows us to learn pedestrian embeddings from raw videos, without resorting to pseudo labels. The goal is to construct a self-supervised pretext task that matches the person re-ID objective. Inspired by the data association concept in multi-object tracking, we propose the Cycle Association (CycAs) task: after performing data association between a pair of video frames forward and then backward, a pedestrian instance is supposed to be associated to itself. To fulfill this goal, the model must learn a meaningful representation that can well describe correspondences between instances in frame pairs. We adapt the discrete association process to a differentiable form, such that end-to-end training becomes feasible. Experiments are conducted in two aspects: We first compare our method with existing unsupervised re-ID methods on seven benchmarks and demonstrate CycAs' superiority. Then, to further validate the practical value of CycAs in real-world applications, we perform training on self-collected videos and report promising performance on standard test sets.

READ FULL TEXT

page 2

page 7

research
11/07/2022

Generalizable Re-Identification from Videos with Cycle Association

In this paper, we are interested in learning a generalizable person re-i...
research
05/17/2023

S^3Track: Self-supervised Tracking with Soft Assignment Flow

In this work, we study self-supervised multiple object tracking without ...
research
08/22/2018

Deep Association Learning for Unsupervised Video Person Re-identification

Deep learning methods have started to dominate the research progress of ...
research
10/19/2018

Deep Person Re-identification for Probabilistic Data Association in Multiple Pedestrian Tracking

We present a data association method for vision-based multiple pedestria...
research
04/02/2022

A Free Lunch to Person Re-identification: Learning from Automatically Generated Noisy Tracklets

A series of unsupervised video-based re-identification (re-ID) methods h...
research
06/10/2021

Unsupervised Video Person Re-identification via Noise and Hard frame Aware Clustering

Unsupervised video-based person re-identification (re-ID) methods extrac...
research
09/01/2023

Object-Centric Multiple Object Tracking

Unsupervised object-centric learning methods allow the partitioning of s...

Please sign up or login with your details

Forgot password? Click here to reset