TRAT: Tracking by Attention Using Spatio-Temporal Features

11/18/2020
by   Hasan Saribas, et al.
1

Robust object tracking requires knowledge of tracked objects' appearance, motion and their evolution over time. Although motion provides distinctive and complementary information especially for fast moving objects, most of the recent tracking architectures primarily focus on the objects' appearance information. In this paper, we propose a two-stream deep neural network tracker that uses both spatial and temporal features. Our architecture is developed over ATOM tracker and contains two backbones: (i) 2D-CNN network to capture appearance features and (ii) 3D-CNN network to capture motion features. The features returned by the two networks are then fused with attention based Feature Aggregation Module (FAM). Since the whole architecture is unified, it can be trained end-to-end. The experimental results show that the proposed tracker TRAT (TRacking by ATtention) achieves state-of-the-art performance on most of the benchmarks and it significantly outperforms the baseline ATOM tracker.

READ FULL TEXT

page 1

page 5

research
12/14/2021

Joint 3D Object Detection and Tracking Using Spatio-Temporal Representation of Camera Image and LiDAR Point Clouds

In this paper, we propose a new joint object detection and tracking (JoD...
research
09/03/2023

UnsMOT: Unified Framework for Unsupervised Multi-Object Tracking with Geometric Topology Guidance

Object detection has long been a topic of high interest in computer visi...
research
12/16/2018

Model-free Tracking with Deep Appearance and Motion Features Integration

Being able to track an anonymous object, a model-free tracker is compreh...
research
11/18/2018

Exploit the Connectivity: Multi-Object Tracking with TrackletNet

Multi-object tracking (MOT) is an important and practical task related t...
research
06/05/2023

MotionTrack: Learning Motion Predictor for Multiple Object Tracking

Significant advancements have been made in multi-object tracking (MOT) w...
research
10/02/2020

Leveraging Tacit Information Embedded in CNN Layers for Visual Tracking

Different layers in CNNs provide not only different levels of abstractio...
research
05/13/2020

Robust Visual Object Tracking with Two-Stream Residual Convolutional Networks

The current deep learning based visual tracking approaches have been ver...

Please sign up or login with your details

Forgot password? Click here to reset