Deep Feature Tracker: A Novel Application for Deep Convolutional Neural Networks

07/30/2021
by   Mostafa Parchami, et al.
12

Feature tracking is the building block of many applications such as visual odometry, augmented reality, and target tracking. Unfortunately, the state-of-the-art vision-based tracking algorithms fail in surgical images due to the challenges imposed by the nature of such environments. In this paper, we proposed a novel and unified deep learning-based approach that can learn how to track features reliably as well as learn how to detect such reliable features for tracking purposes. The proposed network dubbed as Deep-PT, consists of a tracker network which is a convolutional neural network simulating cross-correlation in terms of deep learning and two fully connected networks that operate on the output of intermediate layers of the tracker to detect features and predict trackability of the detected points. The ability to detect features based on the capabilities of the tracker distinguishes the proposed method from previous algorithms used in this area and improves the robustness of the algorithms against dynamics of the scene. The network is trained using multiple datasets due to the lack of specialized dataset for feature tracking datasets and extensive comparisons are conducted to compare the accuracy of Deep-PT against recent pixel tracking algorithms. As the experiments suggest, the proposed deep architecture deliberately learns what to track and how to track and outperforms the state-of-the-art methods.

READ FULL TEXT

page 2

page 4

page 5

page 6

research
12/30/2019

Rethinking Convolutional Features in Correlation Filter Based Tracking

Both accuracy and efficiency are of significant importance to the task o...
research
06/05/2019

Single-Camera Basketball Tracker through Pose and Semantic Feature Fusion

Tracking sports players is a widely challenging scenario, specially in s...
research
03/20/2018

Ocean Eddy Identification and Tracking using Neural Networks

Global climate change plays an essential role in our daily life and is n...
research
04/06/2016

Learning to Track at 100 FPS with Deep Regression Networks

Machine learning techniques are often used in computer vision due to the...
research
07/04/2023

EANet: Enhanced Attribute-based RGBT Tracker Network

Tracking objects can be a difficult task in computer vision, especially ...
research
04/11/2023

Efficient Feature Description for Small Body Relative Navigation using Binary Convolutional Neural Networks

Missions to small celestial bodies rely heavily on optical feature track...
research
10/02/2020

Multi-Resolution 3D Convolutional Neural Networks for Automatic Coronary Centerline Extraction in Cardiac CT Angiography Scans

We propose a deep learning-based automatic coronary artery tree centerli...

Please sign up or login with your details

Forgot password? Click here to reset