EANet: Enhanced Attribute-based RGBT Tracker Network

07/04/2023
by   Abbas Türkoğlu, et al.
0

Tracking objects can be a difficult task in computer vision, especially when faced with challenges such as occlusion, changes in lighting, and motion blur. Recent advances in deep learning have shown promise in challenging these conditions. However, most deep learning-based object trackers only use visible band (RGB) images. Thermal infrared electromagnetic waves (TIR) can provide additional information about an object, including its temperature, when faced with challenging conditions. We propose a deep learning-based image tracking approach that fuses RGB and thermal images (RGBT). The proposed model consists of two main components: a feature extractor and a tracker. The feature extractor encodes deep features from both the RGB and the TIR images. The tracker then uses these features to track the object using an enhanced attribute-based architecture. We propose a fusion of attribute-specific feature selection with an aggregation module. The proposed methods are evaluated on the RGBT234 <cit.> and LasHeR <cit.> datasets, which are the most widely used RGBT object-tracking datasets in the literature. The results show that the proposed system outperforms state-of-the-art RGBT object trackers on these datasets, with a relatively smaller number of parameters.

READ FULL TEXT

page 3

page 4

research
12/30/2019

Rethinking Convolutional Features in Correlation Filter Based Tracking

Both accuracy and efficiency are of significant importance to the task o...
research
01/18/2018

PTB-TIR: A Thermal Infrared Pedestrian Tracking Benchmark

Thermal infrared (TIR) pedestrian tracking is one of the most important ...
research
04/08/2022

Visible-Thermal UAV Tracking: A Large-Scale Benchmark and New Baseline

With the popularity of multi-modal sensors, visible-thermal (RGB-T) obje...
research
01/22/2022

Temporal Aggregation for Adaptive RGBT Tracking

Visual object tracking with RGB and thermal infrared (TIR) spectra avail...
research
03/12/2021

Siamese Infrared and Visible Light Fusion Network for RGB-T Tracking

Due to the different photosensitive properties of infrared and visible l...
research
07/30/2021

Deep Feature Tracker: A Novel Application for Deep Convolutional Neural Networks

Feature tracking is the building block of many applications such as visu...
research
05/06/2021

Split and Connect: A Universal Tracklet Booster for Multi-Object Tracking

Multi-object tracking (MOT) is an essential task in the computer vision ...

Please sign up or login with your details

Forgot password? Click here to reset