Rigidity-Aware Detection for 6D Object Pose Estimation

03/22/2023
by   Yang Hai, et al.
0

Most recent 6D object pose estimation methods first use object detection to obtain 2D bounding boxes before actually regressing the pose. However, the general object detection methods they use are ill-suited to handle cluttered scenes, thus producing poor initialization to the subsequent pose network. To address this, we propose a rigidity-aware detection method exploiting the fact that, in 6D pose estimation, the target objects are rigid. This lets us introduce an approach to sampling positive object regions from the entire visible object area during training, instead of naively drawing samples from the bounding box center where the object might be occluded. As such, every visible object part can contribute to the final bounding box prediction, yielding better detection robustness. Key to the success of our approach is a visibility map, which we propose to build using a minimum barrier distance between every pixel in the bounding box and the box boundary. Our results on seven challenging 6D pose estimation datasets evidence that our method outperforms general detection frameworks by a large margin. Furthermore, combined with a pose regression network, we obtain state-of-the-art pose estimation results on the challenging BOP benchmark.

READ FULL TEXT

page 1

page 2

page 4

page 5

page 8

research
11/20/2017

Joint Object Category and 3D Pose Estimation from 2D Images

2D object detection is the task of finding (i) what objects are present ...
research
07/06/2020

Point-Set Anchors for Object Detection, Instance Segmentation and Pose Estimation

A recent approach for object detection and human pose estimation is to r...
research
02/27/2020

SilhoNet-Fisheye: Adaptation of A ROI Based Object Pose Estimation Network to Monocular Fisheye Images

There has been much recent interest in deep learning methods for monocul...
research
12/14/2020

Improving Panoptic Segmentation at All Scales

Crop-based training strategies decouple training resolution from GPU mem...
research
05/14/2019

Improving Head Pose Estimation with a Combined Loss and Bounding Box Margin Adjustment

We address a problem of estimating pose of a person's head from its RGB ...
research
03/03/2023

3D-Aware Object Localization using Gaussian Implicit Occupancy Function

To automatically localize a target object in an image is crucial for man...
research
01/28/2020

A Review on Object Pose Recovery: from 3D Bounding Box Detectors to Full 6D Pose Estimators

Object pose recovery has gained increasing attention in the computer vis...

Please sign up or login with your details

Forgot password? Click here to reset