MPF6D: Masked Pyramid Fusion 6D Pose Estimation

11/17/2021
by   Nuno Pereira, et al.
0

Object pose estimation has multiple important applications, such as robotic grasping and augmented reality. We present a new method to estimate the 6D pose of objects that improves upon the accuracy of current proposals and can still be used in real-time. Our method uses RGB-D data as input to segment objects and estimate their pose. It uses a neural network with multiple heads, one head estimates the object classification and generates the mask, the second estimates the values of the translation vector and the last head estimates the values of the quaternion that represents the rotation of the object. These heads leverage a pyramid architecture used during feature extraction and feature fusion. Our method can be used in real-time with its low inference time of 0.12 seconds and has high accuracy. With this combination of fast inference and good accuracy it is possible to use our method in robotic pick and place tasks and/or augmented reality applications.

READ FULL TEXT
research
11/27/2019

Multi-View Matching Network for 6D Pose Estimation

Applications that interact with the real world such as augmented reality...
research
11/18/2019

MaskedFusion: Mask-based 6D Object Pose Detection

MaskedFusion is a framework to estimate 6D pose of objects using RGB-D d...
research
09/05/2017

6D Object Pose Estimation with Depth Images: A Seamless Approach for Robotic Interaction and Augmented Reality

To determine the 3D orientation and 3D location of objects in the surrou...
research
09/26/2020

I Like to Move It: 6D Pose Estimation as an Action Decision Process

Object pose estimation is an integral part of robot vision and augmented...
research
10/11/2022

CASAPose: Class-Adaptive and Semantic-Aware Multi-Object Pose Estimation

Applications in the field of augmented reality or robotics often require...
research
04/07/2017

Real-time Hand Tracking under Occlusion from an Egocentric RGB-D Sensor

We present an approach for real-time, robust and accurate hand pose esti...

Please sign up or login with your details

Forgot password? Click here to reset