TDIOT: Target-driven Inference for Deep Video Object Tracking

03/19/2021
by   Filiz Gurkan, et al.
0

Recent tracking-by-detection approaches use deep object detectors as target detection baseline, because of their high performance on still images. For effective video object tracking, object detection is integrated with a data association step performed by either a custom design inference architecture or an end-to-end joint training for tracking purpose. In this work, we adopt the former approach and use the pre-trained Mask R-CNN deep object detector as the baseline. We introduce a novel inference architecture placed on top of FPN-ResNet101 backbone of Mask R-CNN to jointly perform detection and tracking, without requiring additional training for tracking purpose. The proposed single object tracker, TDIOT, applies an appearance similarity-based temporal matching for data association. In order to tackle tracking discontinuities, we incorporate a local search and matching module into the inference head layer that exploits SiamFC for short term tracking. Moreover, in order to improve robustness to scale changes, we introduce a scale adaptive region proposal network that enables to search the target at an adaptively enlarged spatial neighborhood specified by the trace of the target. In order to meet long term tracking requirements, a low cost verification layer is incorporated into the inference architecture to monitor presence of the target based on its LBP histogram model. Performance evaluation on videos from VOT2016, VOT2018 and VOT-LT2018 datasets demonstrate that TDIOT achieves higher accuracy compared to the state-of-the-art short-term trackers while it provides comparable performance in long term tracking.

READ FULL TEXT

page 1

page 4

page 6

page 7

page 11

page 12

research
09/12/2018

Learning regression and verification networks for long-term visual tracking

In the long-term single object tracking task, the target moves out of vi...
research
07/15/2022

GUSOT: Green and Unsupervised Single Object Tracking for Long Video Sequences

Supervised and unsupervised deep trackers that rely on deep learning tec...
research
07/01/2019

CDTB: A Color and Depth Visual Object Tracking Dataset and Benchmark

A long-term visual object tracking performance evaluation methodology an...
research
08/26/2020

Learning Global Structure Consistency for Robust Object Tracking

Fast appearance variations and the distractions of similar objects are t...
research
05/18/2021

Finding a Needle in a Haystack: Tiny Flying Object Detection in 4K Videos using a Joint Detection-and-Tracking Approach

Detecting tiny objects in a high-resolution video is challenging because...
research
07/07/2020

ReMOTS: Refining Multi-Object Tracking and Segmentation

We aim to improve the performance of Multiple Object Tracking and Segmen...
research
12/06/2022

Unifying Short and Long-Term Tracking with Graph Hierarchies

Tracking objects over long videos effectively means solving a spectrum o...

Please sign up or login with your details

Forgot password? Click here to reset