Robust Visual Object Tracking with Two-Stream Residual Convolutional Networks

05/13/2020
by   Ning Zhang, et al.
11

The current deep learning based visual tracking approaches have been very successful by learning the target classification and/or estimation model from a large amount of supervised training data in offline mode. However, most of them can still fail in tracking objects due to some more challenging issues such as dense distractor objects, confusing background, motion blurs, and so on. Inspired by the human "visual tracking" capability which leverages motion cues to distinguish the target from the background, we propose a Two-Stream Residual Convolutional Network (TS-RCN) for visual tracking, which successfully exploits both appearance and motion features for model update. Our TS-RCN can be integrated with existing deep learning based visual trackers. To further improve the tracking performance, we adopt a "wider" residual network ResNeXt as its feature extraction backbone. To the best of our knowledge, TS-RCN is the first end-to-end trainable two-stream visual tracking system, which makes full use of both appearance and motion features of the target. We have extensively evaluated the TS-RCN on most widely used benchmark datasets including VOT2018, VOT2019, and GOT-10K. The experiment results have successfully demonstrated that our two-stream model can greatly outperform the appearance based tracker, and it also achieves state-of-the-art performance. The tracking system can run at up to 38.1 FPS.

READ FULL TEXT

page 1

page 3

page 8

research
12/13/2015

Deep Tracking: Visual Tracking Using Deep Convolutional Networks

In this paper, we study a discriminatively trained deep convolutional ne...
research
08/01/2017

CREST: Convolutional Residual Learning for Visual Tracking

Discriminative correlation filters (DCFs) have been shown to perform sup...
research
11/18/2020

TRAT: Tracking by Attention Using Spatio-Temporal Features

Robust object tracking requires knowledge of tracked objects' appearance...
research
06/09/2022

Simple Cues Lead to a Strong Multi-Object Tracker

For a long time, the most common paradigm in Multi-Object Tracking was t...
research
05/02/2020

Derivation of a Constant Velocity Motion Model for Visual Tracking

Motion models play a great role in visual tracking applications for pred...
research
04/15/2019

Learning Discriminative Model Prediction for Tracking

The current strive towards end-to-end trainable computer vision systems ...
research
09/28/2020

Enhancing Continuous Control of Mobile Robots for End-to-End Visual Active Tracking

In the last decades, visual target tracking has been one of the primary ...

Please sign up or login with your details

Forgot password? Click here to reset