Tracking without Label: Unsupervised Multiple Object Tracking via Contrastive Similarity Learning

09/02/2023
by   Sha Meng, et al.
0

Unsupervised learning is a challenging task due to the lack of labels. Multiple Object Tracking (MOT), which inevitably suffers from mutual object interference, occlusion, etc., is even more difficult without label supervision. In this paper, we explore the latent consistency of sample features across video frames and propose an Unsupervised Contrastive Similarity Learning method, named UCSL, including three contrast modules: self-contrast, cross-contrast, and ambiguity contrast. Specifically, i) self-contrast uses intra-frame direct and inter-frame indirect contrast to obtain discriminative representations by maximizing self-similarity. ii) Cross-contrast aligns cross- and continuous-frame matching results, mitigating the persistent negative effect caused by object occlusion. And iii) ambiguity contrast matches ambiguous objects with each other to further increase the certainty of subsequent object association through an implicit manner. On existing benchmarks, our method outperforms the existing unsupervised methods using only limited help from ReID head, and even provides higher accuracy than lots of fully supervised methods.

READ FULL TEXT
research
05/17/2023

S^3Track: Self-supervised Tracking with Soft Assignment Flow

In this work, we study self-supervised multiple object tracking without ...
research
12/09/2020

Contrastive Transformation for Self-supervised Correspondence Learning

In this paper, we focus on the self-supervised learning of visual corres...
research
11/10/2021

Self-Supervised Multi-Object Tracking with Cross-Input Consistency

In this paper, we propose a self-supervised learning procedure for train...
research
03/03/2017

Instance Flow Based Online Multiple Object Tracking

We present a method to perform online Multiple Object Tracking (MOT) of ...
research
04/23/2021

DeepfakeUCL: Deepfake Detection via Unsupervised Contrastive Learning

Face deepfake detection has seen impressive results recently. Nearly all...
research
03/30/2021

Learnable Graph Matching: Incorporating Graph Partitioning with Deep Feature Learning for Multiple Object Tracking

Data association across frames is at the core of Multiple Object Trackin...
research
07/28/2023

Uncertainty-aware Unsupervised Multi-Object Tracking

Without manually annotated identities, unsupervised multi-object tracker...

Please sign up or login with your details

Forgot password? Click here to reset