YOLOff: You Only Learn Offsets for robust 6DoF object pose estimation

02/03/2020
by   Mathieu Gonzalez, et al.
18

Estimating the 3D translation and orientation of an object is a challenging task that can be considered within augmented reality or robotic applications. In this paper, we propose a novel approach to perform 6 DoF object pose estimation from a single RGB-D image in cluttered scenes. We adopt an hybrid pipeline in two stages: data-driven and geometric respectively. The first data-driven step consists of a classification CNN to estimate the object 2D location in the image from local patches, followed by a regression CNN trained to predict the 3D location of a set of keypoints in the camera coordinate system. We robustly perform local voting to recover the location of each keypoint in the camera coordinate system. To extract the pose information, the geometric step consists in aligning the 3D points in the camera coordinate system with the corresponding 3D points in world coordinate system by minimizing a registration error, thus computing the pose. Our experiments on the standard dataset LineMod show that our approach more robust and accurate than state-of-the-art methods.

READ FULL TEXT

page 1

page 5

page 7

page 10

page 13

research
11/11/2019

PVN3D: A Deep Point-wise 3D Keypoints Voting Network for 6DoF Pose Estimation

In this work, we present a novel data-driven method for robust 6DoF obje...
research
09/23/2019

Large Scale Joint Semantic Re-Localisation and Scene Understanding via Globally Unique Instance Coordinate Regression

In this work we present a novel approach to joint semantic localisation ...
research
09/15/2021

Hybrid ICP

ICP algorithms typically involve a fixed choice of data association meth...
research
03/03/2023

Depth-based 6DoF Object Pose Estimation using Swin Transformer

Accurately estimating the 6D pose of objects is crucial for many applica...
research
11/11/2020

A Hybrid Approach for 6DoF Pose Estimation

We propose a method for 6DoF pose estimation of rigid objects that uses ...
research
01/08/2022

Mushrooms Detection, Localization and 3D Pose Estimation using RGB-D Sensor for Robotic-picking Applications

In this paper, we propose mushrooms detection, localization and 3D pose ...
research
04/11/2022

Focal Length and Object Pose Estimation via Render and Compare

We introduce FocalPose, a neural render-and-compare method for jointly e...

Please sign up or login with your details

Forgot password? Click here to reset