6D Object Pose Estimation using Keypoints and Part Affinity Fields

07/05/2021

∙

The task of 6D object pose estimation from RGB images is an important requirement for autonomous service robots to be able to interact with the real world. In this work, we present a two-step pipeline for estimating the 6 DoF translation and orientation of known objects. Keypoints and Part Affinity Fields (PAFs) are predicted from the input image adopting the OpenPose CNN architecture from human pose estimation. Object poses are then calculated from 2D-3D correspondences between detected and model keypoints via the PnP-RANSAC algorithm. The proposed approach is evaluated on the YCB-Video dataset and achieves accuracy on par with recent methods from the literature. Using PAFs to assemble detected keypoints into object instances proves advantageous over only using heatmaps. Models trained to predict keypoints of a single object class perform significantly better than models trained for several classes.

READ FULL TEXT

6D Object Pose Estimation using Keypoints and Part Affinity Fields

PoseCNN: A Convolutional Neural Network for 6D Object Pose Estimation in Cluttered Scenes

Robust 6D Object Pose Estimation in Cluttered Scenes using Semantic Segmentation and Pose Regression Networks

You Only Look at One: Category-Level Object Representations for Pose Estimation From a Single Example

3D Human Pose Estimation = 2D Pose Estimation + Matching

Incremental Learning for Animal Pose Estimation using RBF k-DPP

Geometric Change Detection in Digital Twins using 3D Machine Learning

Sim-to-Real Vision-depth Fusion CNNs for Robust Pose Estimation Aboard Autonomous Nano-quadcopter

6D Object Pose Estimation using Keypoints and Part Affinity Fields

Related Research

PoseCNN: A Convolutional Neural Network for 6D Object Pose Estimation in Cluttered Scenes

Robust 6D Object Pose Estimation in Cluttered Scenes using Semantic Segmentation and Pose Regression Networks

You Only Look at One: Category-Level Object Representations for Pose Estimation From a Single Example

3D Human Pose Estimation = 2D Pose Estimation + Matching

Incremental Learning for Animal Pose Estimation using RBF k-DPP

Geometric Change Detection in Digital Twins using 3D Machine Learning

Sim-to-Real Vision-depth Fusion CNNs for Robust Pose Estimation Aboard Autonomous Nano-quadcopter