KDFNet: Learning Keypoint Distance Field for 6D Object Pose Estimation

09/21/2021
by   Xingyu Liu, et al.
3

We present KDFNet, a novel method for 6D object pose estimation from RGB images. To handle occlusion, many recent works have proposed to localize 2D keypoints through pixel-wise voting and solve a Perspective-n-Point (PnP) problem for pose estimation, which achieves leading performance. However, such voting process is direction-based and cannot handle long and thin objects where the direction intersections cannot be robustly found. To address this problem, we propose a novel continuous representation called Keypoint Distance Field (KDF) for projected 2D keypoint locations. Formulated as a 2D array, each element of the KDF stores the 2D Euclidean distance between the corresponding image pixel and a specified projected 2D keypoint. We use a fully convolutional neural network to regress the KDF for each keypoint. Using this KDF encoding of projected object keypoint locations, we propose to use a distance-based voting scheme to localize the keypoints by calculating circle intersections in a RANSAC fashion. We validate the design choices of our framework by extensive ablation experiments. Our proposed method achieves state-of-the-art performance on Occlusion LINEMOD dataset with an average ADD(-S) accuracy of 50.3 dataset mug subset with an average ADD accuracy of 75.72 experiments and visualizations demonstrate that the proposed method is able to robustly estimate the 6D pose in challenging scenarios including occlusion.

READ FULL TEXT

page 1

page 3

page 4

page 8

research
12/31/2018

PVNet: Pixel-wise Voting Network for 6DoF Pose Estimation

This paper addresses the challenge of 6DoF pose estimation from a single...
research
08/15/2023

Learning Better Keypoints for Multi-Object 6DoF Pose Estimation

We investigate the impact of pre-defined keypoints for pose estimation, ...
research
04/06/2021

Vote from the Center: 6 DoF Pose Estimation in RGB-D Images by Radial Keypoint Voting

We propose a novel keypoint voting scheme based on intersecting spheres,...
research
12/22/2020

3D Point-to-Keypoint Voting Network for 6D Pose Estimation

Object 6D pose estimation is an important research topic in the field of...
research
10/14/2022

Keypoint Cascade Voting for Point Cloud Based 6DoF Pose Estimation

We propose a novel keypoint voting 6DoF object pose estimation method, w...
research
02/10/2020

6DoF Object Pose Estimation via Differentiable Proxy Voting Loss

Estimating a 6DOF object pose from a single image is very challenging du...
research
07/28/2023

Revisiting Fully Convolutional Geometric Features for Object 6D Pose Estimation

Recent works on 6D object pose estimation focus on learning keypoint cor...

Please sign up or login with your details

Forgot password? Click here to reset