Learning Deep Multi-Level Similarity for Thermal Infrared Object Tracking

06/09/2019
by   Qiao Liu, et al.
5

Existing deep Thermal InfraRed (TIR) trackers only use semantic features to describe the TIR object, which lack the sufficient discriminative capacity for handling distractors. This becomes worse when the feature extraction network is only trained on RGB images.To address this issue, we propose a multi-level similarity model under a Siamese framework for robust TIR object tracking. Specifically, we compute different pattern similarities on two convolutional layers using the proposed multi-level similarity network. One of them focuses on the global semantic similarity and the other computes the local structural similarity of the TIR object. These two similarities complement each other and hence enhance the discriminative capacity of the network for handling distractors. In addition, we design a simple while effective relative entropy based ensemble subnetwork to integrate the semantic and structural similarities. This subnetwork can adaptive learn the weights of the semantic and structural similarities at the training stage. To further enhance the discriminative capacity of the tracker, we construct the first large scale TIR video sequence dataset for training the proposed model. The proposed TIR dataset not only benefits the training for TIR tracking but also can be applied to numerous TIR vision tasks. Extensive experimental results on the VOT-TIR2015 and VOT-TIR2017 benchmarks demonstrate that the proposed algorithm performs favorably against the state-of-the-art methods.

READ FULL TEXT

page 5

page 6

page 8

page 15

research
11/27/2017

Hierarchical Siamese Network for Thermal Infrared Object Tracking

Most thermal infrared (TIR) tracking methods are discriminative, which t...
research
11/26/2019

Multi-Task Driven Feature Models for Thermal Infrared Tracking

Existing deep Thermal InfraRed (TIR) trackers usually use the feature mo...
research
03/30/2018

Efficient and Deep Person Re-Identification using Multi-Level Similarity

Person Re-Identification (ReID) requires comparing two images of person ...
research
10/13/2018

Efficient Multi-level Correlating for Visual Tracking

Correlation filter (CF) based tracking algorithms have demonstrated favo...
research
05/23/2018

RGB-T Object Tracking:Benchmark and Baseline

RGB-Thermal (RGB-T) object tracking receives more and more attention due...
research
04/23/2018

Efficient Object Tracking based on Circular and Structural Multi-level Learners

We propose a novel efficient tracking framework. Firstly, we incorporate...
research
04/30/2021

Updatable Siamese Tracker with Two-stage One-shot Learning

Offline Siamese networks have achieved very promising tracking performan...

Please sign up or login with your details

Forgot password? Click here to reset