Vote from the Center: 6 DoF Pose Estimation in RGB-D Images by Radial Keypoint Voting

by   Yangzheng Wu, et al.

We propose a novel keypoint voting scheme based on intersecting spheres, that is more accurate than existing schemes and allows for a smaller set of more disperse keypoints. The scheme forms the basis of the proposed RCVPose method for 6 DoF pose estimation of 3D objects in RGB-D data, which is particularly effective at handling occlusions. A CNN is trained to estimate the distance between the 3D point corresponding to the depth mode of each RGB pixel, and a set of 3 disperse keypoints defined in the object frame. At inference, a sphere of radius equal to this estimated distance is generated, centered at each 3D point. The surface of these spheres votes to increment a 3D accumulator space, the peaks of which indicate keypoint locations. The proposed radial voting scheme is more accurate than previous vector or offset schemes, and robust to disperse keypoints. Experiments demonstrate RCVPose to be highly accurate and competitive, achieving state-of-the-art results on LINEMOD 99.7 97.2 challenging Occlusion LINEMOD 71.1


page 4

page 8

page 16


Keypoint Cascade Voting for Point Cloud Based 6DoF Pose Estimation

We propose a novel keypoint voting 6DoF object pose estimation method, w...

KDFNet: Learning Keypoint Distance Field for 6D Object Pose Estimation

We present KDFNet, a novel method for 6D object pose estimation from RGB...

Learning Better Keypoints for Multi-Object 6DoF Pose Estimation

We investigate the impact of pre-defined keypoints for pose estimation, ...

Sim2Real 3D Object Classification using Spherical Kernel Point Convolution and a Deep Center Voting Scheme

While object semantic understanding is essential for most service roboti...

Neural Voting Field for Camera-Space 3D Hand Pose Estimation

We present a unified framework for camera-space 3D hand pose estimation ...

6DoF Object Pose Estimation via Differentiable Proxy Voting Loss

Estimating a 6DOF object pose from a single image is very challenging du...

Deep Fusion Transformer Network with Weighted Vector-Wise Keypoints Voting for Robust 6D Object Pose Estimation

One critical challenge in 6D object pose estimation from a single RGBD i...

Please sign up or login with your details

Forgot password? Click here to reset