Tracking by Associating Clips

12/20/2022
by   Sanghyun Woo, et al.
0

The tracking-by-detection paradigm today has become the dominant method for multi-object tracking and works by detecting objects in each frame and then performing data association across frames. However, its sequential frame-wise matching property fundamentally suffers from the intermediate interruptions in a video, such as object occlusions, fast camera movements, and abrupt light changes. Moreover, it typically overlooks temporal information beyond the two frames for matching. In this paper, we investigate an alternative by treating object association as clip-wise matching. Our new perspective views a single long video sequence as multiple short clips, and then the tracking is performed both within and between the clips. The benefits of this new approach are two folds. First, our method is robust to tracking error accumulation or propagation, as the video chunking allows bypassing the interrupted frames, and the short clip tracking avoids the conventional error-prone long-term track memory management. Second, the multiple frame information is aggregated during the clip-wise matching, resulting in a more accurate long-range track association than the current frame-wise matching. Given the state-of-the-art tracking-by-detection tracker, QDTrack, we showcase how the tracking performance improves with our new tracking formulation. We evaluate our proposals on two tracking benchmarks, TAO and MOT17 that have complementary characteristics and challenges each other.

READ FULL TEXT

page 2

page 8

page 13

research
05/06/2019

Frame-wise Motion and Appearance for Real-time Multiple Object Tracking

The main challenge of Multiple Object Tracking (MOT) is the efficiency i...
research
02/25/2019

Unsupervised learning-based long-term superpixel tracking

Finding correspondences between structural entities decomposing images i...
research
11/24/2014

Multiple object tracking with context awareness

Multiple people tracking is a key problem for many applications such as ...
research
12/19/2016

Exploring Structure for Long-Term Tracking of Multiple Objects in Sports Videos

In this paper, we propose a novel approach for exploiting structural rel...
research
02/28/2023

DFR-FastMOT: Detection Failure Resistant Tracker for Fast Multi-Object Tracking Based on Sensor Fusion

Persistent multi-object tracking (MOT) allows autonomous vehicles to nav...
research
07/15/2020

Tracking Passengers and Baggage Items using Multi-camera Systems at Security Checkpoints

We introduce a novel tracking-by-detection framework to track multiple o...
research
03/12/2016

Temporally Robust Global Motion Compensation by Keypoint-based Congealing

Global motion compensation (GMC) removes the impact of camera motion and...

Please sign up or login with your details

Forgot password? Click here to reset