SPEED+: Next Generation Dataset for Spacecraft Pose Estimation across Domain Gap

10/06/2021
by   Tae Ha Park, et al.
4

Autonomous vision-based spaceborne navigation is an enabling technology for future on-orbit servicing and space logistics missions. While computer vision in general has benefited from Machine Learning (ML), training and validating spaceborne ML models are extremely challenging due to the impracticality of acquiring a large-scale labeled dataset of images of the intended target in the space environment. Existing datasets, such as Spacecraft PosE Estimation Dataset (SPEED), have so far mostly relied on synthetic images for both training and validation, which are easy to mass-produce but fail to resemble the visual features and illumination variability inherent to the target spaceborne images. In order to bridge the gap between the current practices and the intended applications in future space missions, this paper introduces SPEED+: the next generation spacecraft pose estimation dataset with specific emphasis on domain gap. In addition to 60,000 synthetic images for training, SPEED+ includes 9,531 simulated images of a spacecraft mockup model captured from the Testbed for Rendezvous and Optical Navigation (TRON) facility. TRON is a first-of-a-kind robotic testbed capable of capturing an arbitrary number of target images with accurate and maximally diverse pose labels and high-fidelity spaceborne illumination conditions. SPEED+ will be used in the upcoming international Satellite Pose Estimation Challenge co-hosted with the Advanced Concepts Team of the European Space Agency to evaluate and compare the robustness of spaceborne ML models trained on synthetic images.

READ FULL TEXT

page 2

page 5

page 6

page 7

page 18

page 19

page 20

page 21

research
11/05/2019

Satellite Pose Estimation Challenge: Dataset, Competition Design and Results

Reliable pose estimation of uncooperative satellites is a key technology...
research
08/12/2021

Robotic Testbed for Rendezvous and Optical Navigation: Multi-Source Calibration and Machine Learning Use Cases

This work presents the most recent advances of the Robotic Testbed for R...
research
09/24/2022

Towards Bridging the Space Domain Gap for Satellite Pose Estimation using Event Sensing

Deep models trained using synthetic data require domain adaptation to br...
research
09/19/2018

Pose Estimation for Non-Cooperative Spacecraft Rendezvous Using Convolutional Neural Networks

On-board estimation of the pose of an uncooperative target spacecraft is...
research
03/08/2022

Robust Multi-Task Learning and Online Refinement for Spacecraft Pose Estimation across Domain Gap

This work presents Spacecraft Pose Network v2 (SPNv2), a Convolutional N...
research
09/20/2023

Online Supervised Training of Spaceborne Vision during Proximity Operations using Adaptive Kalman Filtering

This work presents an Online Supervised Training (OST) method to enable ...
research
06/09/2023

Data-Link: High Fidelity Manufacturing Datasets for Model2Real Transfer under Industrial Settings

High-fidelity datasets play a pivotal role in imbuing simulators with re...

Please sign up or login with your details

Forgot password? Click here to reset