Explicitly Modeling the Discriminability for Instance-Aware Visual Object Tracking

10/28/2021
by   Mengmeng Wang, et al.
0

Visual object tracking performance has been dramatically improved in recent years, but some severe challenges remain open, like distractors and occlusions. We suspect the reason is that the feature representations of the tracking targets are only expressively learned but not fully discriminatively modeled. In this paper, we propose a novel Instance-Aware Tracker (IAT) to explicitly excavate the discriminability of feature representations, which improves the classical visual tracking pipeline with an instance-level classifier. First, we introduce a contrastive learning mechanism to formulate the classification task, ensuring that every training sample could be uniquely modeled and be highly distinguishable from plenty of other samples. Besides, we design an effective negative sample selection scheme to contain various intra and inter classes in the instance classification branch. Furthermore, we implement two variants of the proposed IAT, including a video-level one and an object-level one. They realize the concept of instance in different granularity as videos and target bounding boxes, respectively. The former enhances the ability to recognize the target from the background while the latter boosts the discriminative power for mitigating the target-distractor dilemma. Extensive experimental evaluations on 8 benchmark datasets show that both two versions of the proposed IAT achieve leading results against state-of-the-art methods while running at 30FPS. Code will be available when it is published.

READ FULL TEXT

page 2

page 10

page 11

page 19

research
03/21/2022

Robust Visual Tracking by Segmentation

Estimating the target extent poses a fundamental challenge in visual obj...
research
03/21/2023

OmniTracker: Unifying Object Tracking by Tracking-with-Detection

Object tracking (OT) aims to estimate the positions of target objects in...
research
02/21/2019

Online Multi-Object Tracking with Instance-Aware Tracker and Dynamic Model Refreshment

Recent progresses in model-free single object tracking (SOT) algorithms ...
research
11/25/2018

Describe and Attend to Track: Learning Natural Language guided Structural Representation and Visual Attention for Object Tracking

The tracking-by-detection framework requires a set of positive and negat...
research
07/01/2020

Motion Prediction in Visual Object Tracking

Visual object tracking (VOT) is an essential component for many applicat...
research
08/30/2023

Occlusion-Aware Detection and Re-ID Calibrated Network for Multi-Object Tracking

Multi-Object Tracking (MOT) is a crucial computer vision task that aims ...
research
08/27/2018

Real-Time MDNet

We present a fast and accurate visual tracking algorithm based on the mu...

Please sign up or login with your details

Forgot password? Click here to reset