How to track your dragon: A Multi-Attentional framework for real-time 6-DOF RGB-D Object Pose Tracking

04/22/2020
by   Isidoros Marougkas, et al.
0

We present a novel multi-attentional convolutional architecture to tackle the problem of real-time RGB-D 6D object pose tracking of single, known objects. Such a problem poses multiple challenges originating both from the objects’ nature and their interaction with their environment, which previous approaches have failed to fully address. The proposed framework encapsulates methods for background clutter and occlusion handling by integrating multiple parallel soft spatial attention modules into a multitask Convolutional Neural Network (CNN) architecture. Moreover, we consider the special geometrical properties of both the object’s 3D model and the pose space, and we use a more sophisticated approach for data augmentation for training. The provided experimental results confirm the effectiveness of the proposed multi-attentional architecture, as it improves the State-of-the-Art (SoA) tracking performance by an average score of 40.5% for translation and 57.5% for rotation, when testing on the dataset presented in [1], the most complete dataset designed, up to date, for the problem of RGB-D object tracking.

READ FULL TEXT

page 1

page 2

04/21/2020

How to track your dragon: A Multi-Attentional Framework for real-time RGB-D 6DOF Object Pose Tracking

We present a novel multi-attentional convolutional architecture to tack...
04/21/2020

How to track your dragon: A Multi-Attentional Framework for real-time RGB-D 6-DOF Object Pose Tracking

We present a novel multi-attentional convolutional architecture to tackl...
05/22/2019

PoseRBPF: A Rao-Blackwellized Particle Filter for 6D Object Pose Tracking

Tracking 6D poses of objects from videos provides rich information to a ...
02/19/2020

JRMOT: A Real-Time 3D Multi-Object Tracker and a New Large-Scale Dataset

An autonomous navigating agent needs to perceive and track the motion of...
11/06/2021

ROFT: Real-Time Optical Flow-Aided 6D Object Pose and Velocity Tracking

6D object pose tracking has been extensively studied in the robotics and...
04/03/2022

ES6D: A Computation Efficient and Symmetry-Aware 6D Pose Regression Framework

In this paper, a computation efficient regression framework is presented...