PoseCNN: A Convolutional Neural Network for 6D Object Pose Estimation in Cluttered Scenes

11/01/2017
by   Yu Xiang, et al.
0

Estimating the 6D pose of known objects is important for robots to interact with objects in the real world. The problem is challenging due to the variety of objects as well as the complexity of the scene caused by clutter and occlusion between objects. In this work, we introduce a new Convolutional Neural Network (CNN) for 6D object pose estimation named PoseCNN. PoseCNN estimates the 3D translation of an object by localizing its center in the image and predicting its distance from the camera. The 3D rotation of the object is estimated by regressing to a quaternion representation. PoseCNN is able to handle symmetric objects and is also robust to occlusion between objects. In addition, we contribute a large scale video dataset for 6D object pose estimation named the YCB-Video dataset. Our dataset provides accurate 6D poses of 21 objects from the YCB dataset observed in 92 videos with 133,827 frames. We conduct experiments on our YCB-Video dataset and the OccludedLINEMOD dataset to show that PoseCNN provides very good estimates using only color as input.

READ FULL TEXT

page 1

page 3

page 5

page 6

page 8

research
03/31/2017

BB8: A Scalable, Accurate, Robust to Partial Occlusion Method for Predicting the 3D Poses of Challenging Objects without Using Depth

We introduce a novel method for 3D object detection and pose estimation ...
research
09/18/2018

SilhoNet: An RGB Method for 3D Object Pose Estimation and Grasp Planning

Autonomous robot manipulation often involves both estimating the pose of...
research
01/29/2020

Assistive Relative Pose Estimation for On-orbit Assembly using Convolutional Neural Networks

Accurate real-time pose estimation of spacecraft or object in space is a...
research
07/05/2021

6D Object Pose Estimation using Keypoints and Part Affinity Fields

The task of 6D object pose estimation from RGB images is an important re...
research
05/26/2023

Generalizable Pose Estimation Using Implicit Scene Representations

6-DoF pose estimation is an essential component of robotic manipulation ...
research
09/21/2021

StereOBJ-1M: Large-scale Stereo Image Dataset for 6D Object Pose Estimation

We present a large-scale stereo RGB image object pose estimation dataset...
research
01/19/2017

T-LESS: An RGB-D Dataset for 6D Pose Estimation of Texture-less Objects

We introduce T-LESS, a new public dataset for estimating the 6D pose, i....

Please sign up or login with your details

Forgot password? Click here to reset