Bridging the Domain Gap in Satellite Pose Estimation: a Self-Training Approach based on Geometrical Constraints

12/23/2022
by   Zi Wang, et al.
0

Recently, unsupervised domain adaptation in satellite pose estimation has gained increasing attention, aiming at alleviating the annotation cost for training deep models. To this end, we propose a self-training framework based on the domain-agnostic geometrical constraints. Specifically, we train a neural network to predict the 2D keypoints of a satellite and then use PnP to estimate the pose. The poses of target samples are regarded as latent variables to formulate the task as a minimization problem. Furthermore, we leverage fine-grained segmentation to tackle the information loss issue caused by abstracting the satellite as sparse keypoints. Finally, we iteratively solve the minimization problem in two steps: pseudo-label generation and network training. Experimental results show that our method adapts well to the target domain. Moreover, our method won the 1st place on the sunlamp task of the second international Satellite Pose Estimation Competition.

READ FULL TEXT

page 1

page 2

page 4

page 6

page 9

page 10

page 13

research
09/24/2022

Towards Bridging the Space Domain Gap for Satellite Pose Estimation using Event Sensing

Deep models trained using synthetic data require domain adaptation to br...
research
03/08/2022

Robust Multi-Task Learning and Online Refinement for Spacecraft Pose Estimation across Domain Gap

This work presents Spacecraft Pose Network v2 (SPNv2), a Convolutional N...
research
12/27/2022

Spacecraft Pose Estimation Based on Unsupervised Domain Adaptation and on a 3D-Guided Loss Combination

Spacecraft pose estimation is a key task to enable space missions in whi...
research
11/24/2021

UDA-COPE: Unsupervised Domain Adaptation for Category-level Object Pose Estimation

Learning to estimate object pose often requires ground-truth (GT) labels...
research
08/26/2021

Unsupervised domain adaptation for clinician pose estimation and instance segmentation in the OR

The fine-grained localization of clinicians in the operating room (OR) i...
research
05/18/2023

Manifold-Aware Self-Training for Unsupervised Domain Adaptation on Regressing 6D Object Pose

Domain gap between synthetic and real data in visual regression (6D pose...
research
06/10/2022

Unsupervised Foggy Scene Understanding via Self Spatial-Temporal Label Diffusion

Understanding foggy image sequence in the driving scenes is critical for...

Please sign up or login with your details

Forgot password? Click here to reset