KRF: Keypoint Refinement with Fusion Network for 6D Pose Estimation

10/07/2022
by   Irvin Haozhe Zhan, et al.
0

Existing refinement methods gradually lose their ability to further improve pose estimation methods' accuracy. In this paper, we propose a new refinement pipeline, Keypoint Refinement with Fusion Network (KRF), for 6D pose estimation, especially for objects with serious occlusion. The pipeline consists of two steps. It first completes the input point clouds via a novel point completion network. The network uses both local and global features, considering the pose information during point completion. Then, it registers the completed object point cloud with corresponding target point cloud by Color supported Iterative KeyPoint (CIKP). The CIKP method introduces color information into registration and registers point cloud around each keypoint to increase stability. The KRF pipeline can be integrated with existing popular 6D pose estimation methods, e.g. the full flow bidirectional fusion network, to further improved their pose estimation accuracy. Experiments show that our method outperforms the state-of-the-art method from 93.9% to 94.4% on YCB-Video dataset and from 64.4% to 66.8% on Occlusion LineMOD dataset. Our source code is available at https://github.com/zhanhz/KRF.

READ FULL TEXT

page 1

page 3

page 6

research
12/13/2021

Local and Global Point Cloud Reconstruction for 3D Hand Pose Estimation

This paper addresses the 3D point cloud reconstruction and 3D pose estim...
research
03/28/2023

GP3D: Generalized Pose Estimation in 3D Point Clouds: A case study on bin picking

In this paper, we present GP3D, a novel network for generalized pose est...
research
10/21/2022

CRT-6D: Fast 6D Object Pose Estimation with Cascaded Refinement Transformers

Learning based 6D object pose estimation methods rely on computing large...
research
03/02/2021

CloudAAE: Learning 6D Object Pose Regression with On-line Data Synthesis on Point Clouds

It is often desired to train 6D pose estimation systems on synthetic dat...
research
08/10/2023

Deep Fusion Transformer Network with Weighted Vector-Wise Keypoints Voting for Robust 6D Object Pose Estimation

One critical challenge in 6D object pose estimation from a single RGBD i...
research
08/16/2018

Occlusion Resistant Object Rotation Regression from Point Cloud Segments

Rotation estimation of known rigid objects is important for robotic appl...
research
09/16/2023

Outram: One-shot Global Localization via Triangulated Scene Graph and Global Outlier Pruning

One-shot LiDAR localization refers to the ability to estimate the robot ...

Please sign up or login with your details

Forgot password? Click here to reset