Deep Learning for Real Time Satellite Pose Estimation on Low Power Edge TPU

04/07/2022
by   Alessandro Lotti, et al.
0

Pose estimation of an uncooperative space resident object is a key asset towards autonomy in close proximity operations. In this context monocular cameras are a valuable solution because of their low system requirements. However, the associated image processing algorithms are either too computationally expensive for real time on-board implementation, or not enough accurate. In this paper we propose a pose estimation software exploiting neural network architectures which can be scaled to different accuracy-latency trade-offs. We designed our pipeline to be compatible with Edge Tensor Processing Units to show how low power machine learning accelerators could enable Artificial Intelligence exploitation in space. The neural networks were tested both on the benchmark Spacecraft Pose Estimation Dataset, and on the purposely developed Cosmo Photorealistic Dataset, which depicts a COSMO-SkyMed satellite in a variety of random poses and steerable solar panels orientations. The lightest version of our architecture achieves state-of-the-art accuracy on both datasets but at a fraction of networks complexity, running at 7.7 frames per second on a Coral Dev Board Mini consuming just 2.2W.

READ FULL TEXT

page 1

page 2

research
01/23/2021

Real-Time, Flight-Ready, Non-Cooperative Spacecraft Pose Estimation Using Monocular Imagery

A key requirement for autonomous on-orbit proximity operations is the es...
research
11/05/2019

Satellite Pose Estimation Challenge: Dataset, Competition Design and Results

Reliable pose estimation of uncooperative satellites is a key technology...
research
08/30/2019

Satellite Pose Estimation with Deep Landmark Regression and Nonlinear Pose Refinement

We propose an approach to estimate the 6DOF pose of a satellite, relativ...
research
07/06/2021

Real-time Pose Estimation from Images for Multiple Humanoid Robots

Pose estimation commonly refers to computer vision methods that recogniz...
research
04/05/2022

Towards On-Board Panoptic Segmentation of Multispectral Satellite Images

With tremendous advancements in low-power embedded computing devices and...
research
07/17/2023

Fast model inference and training on-board of Satellites

Artificial intelligence onboard satellites has the potential to reduce d...
research
11/29/2018

Real-time 2D Multi-Person Pose Estimation on CPU: Lightweight OpenPose

In this work we adapt multi-person pose estimation architecture to use i...

Please sign up or login with your details

Forgot password? Click here to reset