GeoMultiTaskNet: remote sensing unsupervised domain adaptation using geographical coordinates

04/16/2023
by   Valerio Marsocci, et al.
0

Land cover maps are a pivotal element in a wide range of Earth Observation (EO) applications. However, annotating large datasets to develop supervised systems for remote sensing (RS) semantic segmentation is costly and time-consuming. Unsupervised Domain Adaption (UDA) could tackle these issues by adapting a model trained on a source domain, where labels are available, to a target domain, without annotations. UDA, while gaining importance in computer vision, is still under-investigated in RS. Thus, we propose a new lightweight model, GeoMultiTaskNet, based on two contributions: a GeoMultiTask module (GeoMT), which utilizes geographical coordinates to align the source and target domains, and a Dynamic Class Sampling (DCS) strategy, to adapt the semantic segmentation loss to the frequency of classes. This approach is the first to use geographical metadata for UDA in semantic segmentation. It reaches state-of-the-art performances (47,22 number of parameters (33M), on a subset of the FLAIR dataset, a recently proposed dataset properly shaped for RS UDA, used for the first time ever for research scopes here.

READ FULL TEXT

page 2

page 5

page 7

research
05/13/2020

SRDA-Net: Super-Resolution Domain Adaptation Networks for Semantic Segmentation

Recently, Unsupervised Domain Adaptation (UDA) was proposed to address t...
research
05/17/2023

Integrating Multiple Sources Knowledge for Class Asymmetry Domain Adaptation Segmentation of Remote Sensing Images

In the existing unsupervised domain adaptation (UDA) methods for remote ...
research
01/27/2022

ResiDualGAN: Resize-Residual DualGAN for Cross-Domain Remote Sensing Images Semantic Segmentation

The performance of a semantic segmentation model for remote sensing (RS)...
research
08/16/2022

Unsupervised domain adaptation semantic segmentation of high-resolution remote sensing imagery with invariant domain-level context memory

Semantic segmentation is a key technique involved in automatic interpret...
research
11/27/2019

Class-Conditional Domain Adaptation on Semantic Segmentation

Semantic segmentation is an important sub-task for many applications, bu...
research
09/13/2022

High-resolution semantically-consistent image-to-image translation

Deep learning has become one of remote sensing scientists' most efficien...

Please sign up or login with your details

Forgot password? Click here to reset