MFST: Multi-Features Siamese Tracker

03/01/2021
by   Zhenxi Li, et al.
0

Siamese trackers have recently achieved interesting results due to their balance between accuracy and speed. This success is mainly due to the fact that deep similarity networks were specifically designed to address the image similarity problem. Therefore, they are inherently more appropriate than classical CNNs for the tracking task. However, Siamese trackers rely on the last convolutional layers for similarity analysis and target search, which restricts their performance. In this paper, we argue that using a single convolutional layer as feature representation is not the optimal choice within the deep similarity framework, as multiple convolutional layers provide several abstraction levels in characterizing an object. Starting from this motivation, we present the Multi-Features Siamese Tracker (MFST), a novel tracking algorithm exploiting several hierarchical feature maps for robust deep similarity tracking. MFST proceeds by fusing hierarchical features to ensure a richer and more efficient representation. Moreover, we handle appearance variation by calibrating deep features extracted from two different CNN models. Based on this advanced feature representation, our algorithm achieves high tracking accuracy, while outperforming several state-of-the-art trackers, including standard Siamese trackers. The code and trained models are available at https://github.com/zhenxili96/MFST.

READ FULL TEXT
research
03/01/2021

Multiple Convolutional Features in Siamese Networks for Object Tracking

Siamese trackers demonstrated high performance in object tracking due to...
research
04/08/2021

Siam-ReID: Confuser Aware Siamese Tracker with Re-identification Feature

Siamese deep-network trackers have received significant attention in rec...
research
07/29/2018

Joint Representation and Truncated Inference Learning for Correlation Filter based Tracking

Correlation filter (CF) based trackers generally include two modules, i....
research
07/18/2019

A Strong Feature Representation for Siamese Network Tracker

Object tracking has important application in assistive technologies for ...
research
07/31/2021

HiFT: Hierarchical Feature Transformer for Aerial Tracking

Most existing Siamese-based tracking methods execute the classification ...
research
04/02/2021

Learning to Filter: Siamese Relation Network for Robust Tracking

Despite the great success of Siamese-based trackers, their performance u...
research
10/02/2020

Leveraging Tacit Information Embedded in CNN Layers for Visual Tracking

Different layers in CNNs provide not only different levels of abstractio...

Please sign up or login with your details

Forgot password? Click here to reset