Open Challenges for Monocular Single-shot 6D Object Pose Estimation

02/23/2023
by   Stefan Thalhammer, et al.
0

Object pose estimation is a non-trivial task that enables robotic manipulation, bin picking, augmented reality, and scene understanding, to name a few use cases. Monocular object pose estimation gained considerable momentum with the rise of high-performing deep learning-based solutions and is particularly interesting for the community since sensors are inexpensive and inference is fast. Prior works establish the comprehensive state of the art for diverse pose estimation problems. Their broad scopes make it difficult to identify promising future directions. We narrow down the scope to the problem of single-shot monocular 6D object pose estimation, which is commonly used in robotics, and thus are able to identify such trends. By reviewing recent publications in robotics and computer vision, the state of the art is established at the union of both fields. Following that, we identify promising research directions in order to help researchers to formulate relevant research ideas and effectively advance the state of the art. Findings include that methods are sophisticated enough to overcome the domain shift and that occlusion handling is a fundamental challenge. We also highlight problems such as novel object pose estimation and challenging materials handling as central challenges to advance robotics.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
07/22/2023

Challenges for Monocular 6D Object Pose Estimation in Robotics

Object pose estimation is a core perception task that enables, for examp...
research
05/29/2021

Deep Learning on Monocular Object Pose Detection and Tracking: A Comprehensive Overview

Object pose detection and tracking has recently attracted increasing att...
research
12/04/2022

Review on 6D Object Pose Estimation with the focus on Indoor Scene Understanding

6D object pose estimation problem has been extensively studied in the fi...
research
03/11/2019

Instance- and Category-level 6D Object Pose Estimation

6D object pose estimation is an important task that determines the 3D po...
research
11/02/2022

Sim2Real Grasp Pose Estimation for Adaptive Robotic Applications

Adaptive robotics plays an essential role in achieving truly co-creative...
research
06/10/2017

Recovering 6D Object Pose: Multi-modal Analyses on Challenges

A large number of studies analyse object detection and pose estimation a...
research
11/09/2022

A Solution for a Fundamental Problem of 3D Inference based on 2D Representations

3D inference from monocular vision using neural networks is an important...

Please sign up or login with your details

Forgot password? Click here to reset