How to track your dragon: A Multi-Attentional Framework for real-time RGB-D 6DOF Object Pose Tracking

04/21/2020
by   Isidoros Marougkas, et al.
0

We present a novel multi-attentional convolutional architecture to tackle the problem of real-time RGB-D 6D object pose tracking of single, known objects. Such a problem poses multiple challenges originating both from the objects’ nature and their interaction with their environment, which previous approaches have failed to fully address. The proposed framework encapsulates methods for background clutter and occlusion handling by integrating multiple parallel soft spatial attention modules into a multitask Convolutional Neural Network (CNN) architecture. Moreover, we consider the special geometrical properties of both the object’s 3D model and the pose space, and we use a more sophisticated approach for data augmentation for training. The provided experimental results confirm the effectiveness of the proposed multi-attentional architecture, as it improves the State-of-the-Art (SoA) tracking performance by an average score of 40.5% for translation and 57.5% for rotation, when testing on the dataset presented in [1], the most complete dataset designed, up to date, for the problem of RGB-D object tracking.

READ FULL TEXT

page 1

page 2

04/22/2020

How to track your dragon: A Multi-Attentional framework for real-time 6-DOF RGB-D Object Pose Tracking

We present a novel multi-attentional convolutional architecture to tack...
04/21/2020

How to track your dragon: A Multi-Attentional Framework for real-time RGB-D 6-DOF Object Pose Tracking

We present a novel multi-attentional convolutional architecture to tackl...
04/05/2022

Real-time Online Multi-Object Tracking in Compressed Domain

Recent online Multi-Object Tracking (MOT) methods have achieved desirabl...
06/28/2022

3D Multi-Object Tracking with Differentiable Pose Estimation

We propose a novel approach for joint 3D multi-object tracking and recon...
04/03/2022

ES6D: A Computation Efficient and Symmetry-Aware 6D Pose Regression Framework

In this paper, a computation efficient regression framework is presented...
08/31/2020

Deep Probabilistic Feature-metric Tracking

Dense image alignment from RGB-D images remains a critical issue for rea...
02/19/2020

JRMOT: A Real-Time 3D Multi-Object Tracker and a New Large-Scale Dataset

An autonomous navigating agent needs to perceive and track the motion of...