Remote Sensing Image Scene Classification with Self-Supervised Paradigm under Limited Labeled Samples

10/02/2020
by   Chao Tao, et al.
13

With the development of deep learning, supervised learning methods perform well in remote sensing images (RSIs) scene classification. However, supervised learning requires a huge number of annotated data for training. When labeled samples are not sufficient, the most common solution is to fine-tune the pre-training models using a large natural image dataset (e.g. ImageNet). However, this learning paradigm is not a panacea, especially when the target remote sensing images (e.g. multispectral and hyperspectral data) have different imaging mechanisms from RGB natural images. To solve this problem, we introduce new self-supervised learning (SSL) mechanism to obtain the high-performance pre-training model for RSIs scene classification from large unlabeled data. Experiments on three commonly used RSIs scene classification datasets demonstrated that this new learning paradigm outperforms the traditional dominant ImageNet pre-trained model. Moreover, we analyze the impacts of several factors in SSL on RSIs scene classification tasks, including the choice of self-supervised signals, the domain difference between the source and target dataset, and the amount of pre-training data. The insights distilled from our studies can help to foster the development of SSL in the remote sensing community. Since SSL could learn from unlabeled massive RSIs which are extremely easy to obtain, it will be a potentially promising way to alleviate dependence on labeled samples and thus efficiently solve many problems, such as global mapping.

READ FULL TEXT

page 1

page 2

page 3

research
07/04/2023

In-Domain Self-Supervised Learning Can Lead to Improvements in Remote Sensing Image Classification

Self-supervised learning (SSL) has emerged as a promising approach for r...
research
04/10/2022

TOV: The Original Vision Model for Optical Remote Sensing Image Understanding via Self-supervised Learning

Do we on the right way for remote sensing image understanding (RSIU) by ...
research
06/16/2023

Joint multi-modal Self-Supervised pre-training in Remote Sensing: Application to Methane Source Classification

With the current ubiquity of deep learning methods to solve computer vis...
research
06/24/2022

Self Supervised Learning for Few Shot Hyperspectral Image Classification

Deep learning has proven to be a very effective approach for Hyperspectr...
research
10/02/2018

An Entropic Optimal Transport Loss for Learning Deep Neural Networks under Label Noise in Remote Sensing Images

Deep neural networks have established as a powerful tool for large scale...
research
05/05/2023

Learning Sentinel-2 reflectance dynamics for data-driven assimilation and forecasting

Over the last few years, massive amounts of satellite multispectral and ...
research
02/28/2023

Remote Sensing Scene Classification with Masked Image Modeling (MIM)

Remote sensing scene classification has been extensively studied for its...

Please sign up or login with your details

Forgot password? Click here to reset