Deep Model-Based 6D Pose Refinement in RGB

10/07/2018
by   Fabian Manhardt, et al.
5

We present a novel approach for model-based 6D pose refinement in color data. Building on the established idea of contour-based pose tracking, we teach a deep neural network to predict a translational and rotational update. At the core, we propose a new visual loss that drives the pose update by aligning object contours, thus avoiding the definition of any explicit appearance model. In contrast to previous work our method is correspondence-free, segmentation-free, can handle occlusion and is agnostic to geometrical symmetry as well as visual ambiguities. Additionally, we observe a strong robustness towards rough initialization. The approach can run in real-time and produces pose accuracies that come close to 3D ICP without the need for depth data. Furthermore, our networks are trained from purely synthetic data and will be published together with the refinement code to ensure reproducibility.

READ FULL TEXT

page 2

page 4

page 6

page 9

page 10

page 12

page 13

page 14

research
01/01/2022

SporeAgent: Reinforced Scene-level Plausibility for Object Pose Refinement

Observational noise, inaccurate segmentation and ambiguity due to symmet...
research
03/24/2022

RNNPose: Recurrent 6-DoF Object Pose Refinement with Robust Correspondence Field Estimation and Pose Optimization

6-DoF object pose estimation from a monocular image is challenging, and ...
research
05/13/2020

Pose Proposal Critic: Robust Pose Refinement by Learning Reprojection Errors

In recent years, considerable progress has been made for the task of rig...
research
07/06/2022

Multi-View Object Pose Refinement With Differentiable Renderer

This paper introduces a novel multi-view 6 DoF object pose refinement ap...
research
12/04/2018

Estimating 6D Pose From Localizing Designated Surface Keypoints

In this paper, we present an accurate yet effective solution for 6D pose...
research
06/15/2021

Real-time Pose and Shape Reconstruction of Two Interacting Hands With a Single Depth Camera

We present a novel method for real-time pose and shape reconstruction of...

Please sign up or login with your details

Forgot password? Click here to reset