Deep Learning for Spacecraft Pose Estimation from Photorealistic Rendering

07/09/2019
by   Pedro F. Proença, et al.
1

On-orbit proximity operations in space rendezvous, docking and debris removal require precise and robust 6D pose estimation under a wide range of lighting conditions and against highly textured background, i.e., the Earth. This paper investigates leveraging deep learning and photorealistic rendering for monocular pose estimation of known uncooperative spacecrafts. We first present a simulator built on Unreal Engine 4, named URSO, to generate labeled images of spacecrafts orbiting the Earth, which can be used to train and evaluate neural networks. Secondly, we propose a deep learning framework for pose estimation based on orientation soft classification, which allows modelling orientation ambiguity as a mixture of Gaussians. This framework was evaluated both on URSO datasets and the ESA pose estimation challenge. In this competition, our best model achieved 3rd place on the synthetic test set and 2nd place on the real test set. Moreover, our results show the impact of several architectural and training aspects, and we demonstrate qualitatively how models learned on URSO datasets can perform on real images from space.

READ FULL TEXT

page 1

page 4

page 5

page 6

research
03/13/2023

An Improved Baseline Framework for Pose Estimation Challenge at ECCV 2022 Visual Perception for Navigation in Human Environments Workshop

This technical report describes our first-place solution to the pose est...
research
02/12/2018

Image-based Synthesis for Deep 3D Human Pose Estimation

This paper addresses the problem of 3D human pose estimation in the wild...
research
03/12/2020

CPS: Class-level 6D Pose and Shape Estimation From Monocular Images

Contemporary monocular 6D pose estimation methods can only cope with a h...
research
04/01/2021

Wide-Depth-Range 6D Object Pose Estimation in Space

6D pose estimation in space poses unique challenges that are not commonl...
research
04/25/2022

BronchoPose: an analysis of data and model configuration for vision-based bronchoscopy pose estimation

Vision-based bronchoscopy (VB) models require the registration of the vi...
research
08/30/2019

Satellite Pose Estimation with Deep Landmark Regression and Nonlinear Pose Refinement

We propose an approach to estimate the 6DOF pose of a satellite, relativ...
research
04/16/2019

Disentangling Pose from Appearance in Monochrome Hand Images

Hand pose estimation from the monocular 2D image is challenging due to t...

Please sign up or login with your details

Forgot password? Click here to reset