Shape-Constraint Recurrent Flow for 6D Object Pose Estimation

06/23/2023
by   Yang Hai, et al.
0

Most recent 6D object pose methods use 2D optical flow to refine their results. However, the general optical flow methods typically do not consider the target's 3D shape information during matching, making them less effective in 6D object pose estimation. In this work, we propose a shape-constraint recurrent matching framework for 6D object pose estimation. We first compute a pose-induced flow based on the displacement of 2D reprojection between the initial pose and the currently estimated pose, which embeds the target's 3D shape implicitly. Then we use this pose-induced flow to construct the correlation map for the following matching iterations, which reduces the matching space significantly and is much easier to learn. Furthermore, we use networks to learn the object pose based on the current estimated flow, which facilitates the computation of the pose-induced flow for the next iteration and yields an end-to-end system for object pose. Finally, we optimize the optical flow and object pose simultaneously in a recurrent manner. We evaluate our method on three challenging 6D object pose datasets and show that it outperforms the state of the art significantly in both accuracy and efficiency.

READ FULL TEXT

page 3

page 4

page 8

research
10/27/2022

Bootstrapping Human Optical Flow and Pose

We propose a bootstrapping framework to enhance human optical flow and p...
research
05/28/2022

DeepRM: Deep Recurrent Matching for 6D Pose Refinement

Precise 6D pose estimation of rigid objects from RGB images is a critica...
research
11/06/2021

ROFT: Real-Time Optical Flow-Aided 6D Object Pose and Velocity Tracking

6D object pose tracking has been extensively studied in the robotics and...
research
06/09/2015

Flowing ConvNets for Human Pose Estimation in Videos

The objective of this work is human pose estimation in videos, where mul...
research
05/28/2020

3D human pose estimation with adaptive receptive fields and dilated temporal convolutions

In this work, we demonstrate that receptive fields in 3D pose estimation...
research
04/07/2022

Sparse Optical Flow-Based Line Feature Tracking

In this paper we propose a novel sparse optical flow (SOF)-based line fe...
research
09/10/2017

An Iterative Regression Approach for Face Pose Estimation from RGB Images

This paper presents a iterative optimization method, explicit shape regr...

Please sign up or login with your details

Forgot password? Click here to reset