Self-Supervised Learning of Remote Sensing Scene Representations Using Contrastive Multiview Coding

04/14/2021
by   Vladan Stojnić, et al.
0

In recent years self-supervised learning has emerged as a promising candidate for unsupervised representation learning. In the visual domain its applications are mostly studied in the context of images of natural scenes. However, its applicability is especially interesting in specific areas, like remote sensing and medicine, where it is hard to obtain huge amounts of labeled data. In this work, we conduct an extensive analysis of the applicability of self-supervised learning in remote sensing image classification. We analyze the influence of the number and domain of images used for self-supervised pre-training on the performance on downstream tasks. We show that, for the downstream task of remote sensing image classification, using self-supervised pre-training on remote sensing images can give better results than using supervised pre-training on images of natural scenes. Besides, we also show that self-supervised pre-training can be easily extended to multispectral images producing even better results on our downstream tasks.

READ FULL TEXT
research
07/04/2023

In-Domain Self-Supervised Learning Can Lead to Improvements in Remote Sensing Image Classification

Self-supervised learning (SSL) has emerged as a promising approach for r...
research
06/27/2023

A generic self-supervised learning (SSL) framework for representation learning from spectra-spatial feature of unlabeled remote sensing imagery

Remote sensing data has been widely used for various Earth Observation (...
research
12/03/2021

Self-Supervised Material and Texture Representation Learning for Remote Sensing Tasks

Self-supervised learning aims to learn image feature representations wit...
research
11/15/2022

Self-supervised remote sensing feature learning: Learning Paradigms, Challenges, and Future Works

Deep learning has achieved great success in learning features from massi...
research
04/05/2023

Self-Supervised Siamese Autoencoders

Fully supervised models often require large amounts of labeled training ...
research
04/22/2023

Incomplete Multimodal Learning for Remote Sensing Data Fusion

The mechanism of connecting multimodal signals through self-attention op...
research
08/19/2021

Topo2vec: Topography Embedding Using the Fractal Effect

Recent advances in deep learning have transformed many fields by introdu...

Please sign up or login with your details

Forgot password? Click here to reset