CloudAAE: Learning 6D Object Pose Regression with On-line Data Synthesis on Point Clouds

03/02/2021
by   Ge Gao, et al.
0

It is often desired to train 6D pose estimation systems on synthetic data because manual annotation is expensive. However, due to the large domain gap between the synthetic and real images, synthesizing color images is expensive. In contrast, this domain gap is considerably smaller and easier to fill for depth information. In this work, we present a system that regresses 6D object pose from depth information represented by point clouds, and a lightweight data synthesis pipeline that creates synthetic point cloud segments for training. We use an augmented autoencoder (AAE) for learning a latent code that encodes 6D object pose information for pose regression. The data synthesis pipeline only requires texture-less 3D object models and desired viewpoints, and it is cheap in terms of both time and hardware storage. Our data synthesis process is up to three orders of magnitude faster than commonly applied approaches that render RGB image data. We show the effectiveness of our system on the LineMOD, LineMOD Occlusion, and YCB Video datasets. The implementation of our system is available at: https://github.com/GeeeG/CloudAAE.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/07/2022

KRF: Keypoint Refinement with Fusion Network for 6D Pose Estimation

Existing refinement methods gradually lose their ability to further impr...
research
01/24/2020

6D Object Pose Regression via Supervised Learning on Point Clouds

This paper addresses the task of estimating the 6 degrees of freedom pos...
research
07/14/2020

Pose2RGBD. Generating Depth and RGB images from absolute positions

We propose a method at the intersection of Computer Vision and Computer ...
research
03/07/2020

Robust, Occlusion-aware Pose Estimation for Objects Grasped by Adaptive Hands

Many manipulation tasks, such as placement or within-hand manipulation, ...
research
09/17/2020

Novel View Synthesis from Single Images via Point Cloud Transformation

In this paper the argument is made that for true novel view synthesis of...
research
03/08/2022

Quasi-Balanced Self-Training on Noise-Aware Synthesis of Object Point Clouds for Closing Domain Gap

Semantic analyses of object point clouds are largely driven by releasing...
research
05/07/2022

BiCo-Net: Regress Globally, Match Locally for Robust 6D Pose Estimation

The challenges of learning a robust 6D pose function lie in 1) severe oc...

Please sign up or login with your details

Forgot password? Click here to reset