Vote from the Center: 6 DoF Pose Estimation in RGB-D Images by Radial Keypoint Voting

by   Yangzheng Wu, et al.

We propose a novel keypoint voting scheme based on intersecting spheres, that is more accurate than existing schemes and allows for a smaller set of more disperse keypoints. The scheme forms the basis of the proposed RCVPose method for 6 DoF pose estimation of 3D objects in RGB-D data, which is particularly effective at handling occlusions. A CNN is trained to estimate the distance between the 3D point corresponding to the depth mode of each RGB pixel, and a set of 3 disperse keypoints defined in the object frame. At inference, a sphere of radius equal to this estimated distance is generated, centered at each 3D point. The surface of these spheres votes to increment a 3D accumulator space, the peaks of which indicate keypoint locations. The proposed radial voting scheme is more accurate than previous vector or offset schemes, and robust to disperse keypoints. Experiments demonstrate RCVPose to be highly accurate and competitive, achieving state-of-the-art results on LINEMOD 99.7 97.2 challenging Occlusion LINEMOD 71.1



There are no comments yet.


page 4

page 8

page 16


KDFNet: Learning Keypoint Distance Field for 6D Object Pose Estimation

We present KDFNet, a novel method for 6D object pose estimation from RGB...

PVN3D: A Deep Point-wise 3D Keypoints Voting Network for 6DoF Pose Estimation

In this work, we present a novel data-driven method for robust 6DoF obje...

6DoF Object Pose Estimation via Differentiable Proxy Voting Loss

Estimating a 6DOF object pose from a single image is very challenging du...

PVNet: Pixel-wise Voting Network for 6DoF Pose Estimation

This paper addresses the challenge of 6DoF pose estimation from a single...

Sim2Real 3D Object Classification using Spherical Kernel Point Convolution and a Deep Center Voting Scheme

While object semantic understanding is essential for most service roboti...

3D Point-to-Keypoint Voting Network for 6D Pose Estimation

Object 6D pose estimation is an important research topic in the field of...

ALIKE: Accurate and Lightweight Keypoint Detection and Descriptor Extraction

Existing methods detect the keypoints in a non-differentiable way, there...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.