Correlation-Aware Deep Tracking

03/03/2022
by   Fei Xie, et al.
0

Robustness and discrimination power are two fundamental requirements in visual object tracking. In most tracking paradigms, we find that the features extracted by the popular Siamese-like networks cannot fully discriminatively model the tracked targets and distractor objects, hindering them from simultaneously meeting these two requirements. While most methods focus on designing robust correlation operations, we propose a novel target-dependent feature network inspired by the self-/cross-attention scheme. In contrast to the Siamese-like feature extraction, our network deeply embeds cross-image feature correlation in multiple layers of the feature network. By extensively matching the features of the two images through multiple layers, it is able to suppress non-target features, resulting in instance-varying feature extraction. The output features of the search image can be directly used for predicting target locations without extra correlation step. Moreover, our model can be flexibly pre-trained on abundant unpaired images, leading to notably faster convergence than the existing methods. Extensive experiments show our method achieves the state-of-the-art results while running at real-time. Our feature networks also can be applied to existing tracking pipelines seamlessly to raise the tracking performance. Code will be available.

READ FULL TEXT

page 8

page 11

page 12

page 13

research
11/23/2020

Graph Attention Tracking

Siamese network based trackers formulate the visual tracking task as a s...
research
05/27/2021

Time Varying Particle Data Feature Extraction and Tracking with Neural Networks

Analyzing particle data plays an important role in many scientific appli...
research
08/18/2023

Multi-scale Target-Aware Framework for Constrained Image Splicing Detection and Localization

Constrained image splicing detection and localization (CISDL) is a funda...
research
04/14/2020

Deformable Siamese Attention Networks for Visual Object Tracking

Siamese-based trackers have achieved excellent performance on visual obj...
research
12/05/2021

Learning Tracking Representations via Dual-Branch Fully Transformer Networks

We present a Siamese-like Dual-branch network based on solely Transforme...
research
04/03/2019

Target-Aware Deep Tracking

Existing deep trackers mainly use convolutional neural networks pre-trai...
research
02/12/2023

Variational Voxel Pseudo Image Tracking

Uncertainty estimation is an important task for critical problems, such ...

Please sign up or login with your details

Forgot password? Click here to reset