End-to-End Differentiable 6DoF Object Pose Estimation with Local and Global Constraints

by   Anshul Gupta, et al.

Inferring the 6DoF pose of an object from a single RGB image is an important but challenging task, especially under heavy occlusion. While recent approaches improve upon the two stage approaches by training an end-to-end pipeline, they do not leverage local and global constraints. In this paper, we propose pairwise feature extraction to integrate local constraints, and triplet regularization to integrate global constraints for improved 6DoF object pose estimation. Coupled with better augmentation, our approach achieves state of the art results on the challenging Occlusion Linemod dataset, with a 9 improvement over the previous state of the art, and achieves competitive results on the Linemod dataset.


page 1

page 2

page 3

page 4


SO-Pose: Exploiting Self-Occlusion for Direct 6D Pose Estimation

Directly regressing all 6 degrees-of-freedom (6DoF) for the object pose ...

Object 6D Pose Estimation with Non-local Attention

In this paper, we address the challenging task of estimating 6D object p...

End-to-end Global to Local CNN Learning for Hand Pose Recovery in Depth data

Despite recent advances in 3D pose estimation of human hands, especially...

Occlusion-Aware Object Localization, Segmentation and Pose Estimation

We present a learning approach for localization and segmentation of obje...

Global Hypothesis Generation for 6D Object Pose Estimation

This paper addresses the task of estimating the 6D pose of a known 3D ob...

Local and Global Context-Based Pairwise Models for Sentence Ordering

Sentence Ordering refers to the task of rearranging a set of sentences i...

See the Difference: Direct Pre-Image Reconstruction and Pose Estimation by Differentiating HOG

The Histogram of Oriented Gradient (HOG) descriptor has led to many adva...