Learning to Track Objects from Unlabeled Videos

08/28/2021
by   Jilai Zheng, et al.
0

In this paper, we propose to learn an Unsupervised Single Object Tracker (USOT) from scratch. We identify that three major challenges, i.e., moving object discovery, rich temporal variation exploitation, and online update, are the central causes of the performance bottleneck of existing unsupervised trackers. To narrow the gap between unsupervised trackers and supervised counterparts, we propose an effective unsupervised learning approach composed of three stages. First, we sample sequentially moving objects with unsupervised optical flow and dynamic programming, instead of random cropping. Second, we train a naive Siamese tracker from scratch using single-frame pairs. Third, we continue training the tracker with a novel cycle memory learning scheme, which is conducted in longer temporal spans and also enables our tracker to update online. Extensive experiments show that the proposed USOT learned from unlabeled videos performs well over the state-of-the-art unsupervised trackers by large margins, and on par with recent supervised deep trackers. Code is available at https://github.com/VISION-SJTU/USOT.

READ FULL TEXT

page 3

page 4

page 5

research
04/03/2019

Unsupervised Deep Tracking

We propose an unsupervised visual tracking method in this paper. Differe...
research
07/22/2020

Unsupervised Deep Representation Learning for Real-Time Tracking

The advancement of visual tracking has continuously been brought by deep...
research
04/04/2022

Unsupervised Learning of Accurate Siamese Tracking

Unsupervised learning has been popular in various computer vision tasks,...
research
04/06/2016

Learning to Track at 100 FPS with Deep Regression Networks

Machine learning techniques are often used in computer vision due to the...
research
07/28/2023

Uncertainty-aware Unsupervised Multi-Object Tracking

Without manually annotated identities, unsupervised multi-object tracker...
research
02/28/2018

Modeling Activity Tracker Data Using Deep Boltzmann Machines

Commercial activity trackers are set to become an essential tool in heal...
research
01/26/2023

Self-Supervised RGB-T Tracking with Cross-Input Consistency

In this paper, we propose a self-supervised RGB-T tracking method. Diffe...

Please sign up or login with your details

Forgot password? Click here to reset