Contrastive Multiview Coding with Electro-optics for SAR Semantic Segmentation

08/31/2021
by   Keumgang Cha, et al.
0

In the training of deep learning models, how the model parameters are initialized greatly affects the model performance, sample efficiency, and convergence speed. Representation learning for model initialization has recently been actively studied in the remote sensing field. In particular, the appearance characteristics of the imagery obtained using the a synthetic aperture radar (SAR) sensor are quite different from those of general electro-optical (EO) images, and thus representation learning is even more important in remote sensing domain. Motivated from contrastive multiview coding, we propose multi-modal representation learning for SAR semantic segmentation. Unlike previous studies, our method jointly uses EO imagery, SAR imagery, and a label mask. Several experiments show that our approach is superior to the existing methods in model performance, sample efficiency, and convergence speed.

READ FULL TEXT

page 1

page 5

research
06/02/2022

A Dual-fusion Semantic Segmentation Framework With GAN For SAR Images

Deep learning based semantic segmentation is one of the popular methods ...
research
04/11/2022

Self-supervised Vision Transformers for Joint SAR-optical Representation Learning

Self-supervised learning (SSL) has attracted much interest in remote sen...
research
06/24/2020

X-ModalNet: A Semi-Supervised Deep Cross-Modal Network for Classification of Remote Sensing Data

This paper addresses the problem of semi-supervised transfer learning wi...
research
03/08/2022

Self-Supervision, Remote Sensing and Abstraction: Representation Learning Across 3 Million Locations

Self-supervision based deep learning classification approaches have rece...
research
05/02/2023

DeepAqua: Self-Supervised Semantic Segmentation of Wetlands from SAR Images using Knowledge Distillation

Remote sensing has significantly advanced water detection by applying se...
research
08/24/2022

Learning crop type mapping from regional label proportions in large-scale SAR and optical imagery

The application of deep learning algorithms to Earth observation (EO) in...

Please sign up or login with your details

Forgot password? Click here to reset