Self-supervised Learning of 3D Object Understanding by Data Association and Landmark Estimation for Image Sequence

04/14/2021
by   Hyeonwoo Yu, et al.
0

In this paper, we propose a self-supervised learningmethod for multi-object pose estimation. 3D object under-standing from 2D image is a challenging task that infers ad-ditional dimension from reduced-dimensional information.In particular, the estimation of the 3D localization or orien-tation of an object requires precise reasoning, unlike othersimple clustering tasks such as object classification. There-fore, the scale of the training dataset becomes more cru-cial. However, it is challenging to obtain large amount of3D dataset since achieving 3D annotation is expensive andtime-consuming. If the scale of the training dataset can beincreased by involving the image sequence obtained fromsimple navigation, it is possible to overcome the scale lim-itation of the dataset and to have efficient adaptation tothe new environment. However, when the self annotation isconducted on single image by the network itself, trainingperformance of the network is bounded to the self perfor-mance. Therefore, we propose a strategy to exploit multipleobservations of the object in the image sequence in orderto surpass the self-performance: first, the landmarks for theglobal object map are estimated through network predic-tion and data association, and the corrected annotation fora single frame is obtained. Then, network fine-tuning is con-ducted including the dataset obtained by self-annotation,thereby exceeding the performance boundary of the networkitself. The proposed method was evaluated on the KITTIdriving scene dataset, and we demonstrate the performanceimprovement in the pose estimation of multi-object in 3D space.

READ FULL TEXT

page 3

page 5

research
09/23/2019

Self-supervised 6D Object Pose Estimation for Robot Manipulation

To teach robots skills, it is crucial to obtain data with supervision. S...
research
06/20/2020

Adversarial Transfer of Pose Estimation Regression

We address the problem of camera pose estimation in visual localization....
research
08/19/2023

Pseudo Flow Consistency for Self-Supervised 6D Object Pose Estimation

Most self-supervised 6D object pose estimation methods can only work wit...
research
10/11/2019

FetusMap: Fetal Pose Estimation in 3D Ultrasound

The 3D ultrasound (US) entrance inspires a multitude of automated prenat...
research
06/05/2022

Efficient Annotation and Learning for 3D Hand Pose Estimation: A Survey

In this survey, we present comprehensive analysis of 3D hand pose estima...
research
09/29/2016

Multi-view Self-supervised Deep Learning for 6D Pose Estimation in the Amazon Picking Challenge

Robot warehouse automation has attracted significant interest in recent ...
research
11/21/2022

Deep Projective Rotation Estimation through Relative Supervision

Orientation estimation is the core to a variety of vision and robotics t...

Please sign up or login with your details

Forgot password? Click here to reset