Self-supervised Contrastive Learning for Cross-domain Hyperspectral Image Representation

02/08/2022
by   Hyungtae Lee, et al.
0

Recently, self-supervised learning has attracted attention due to its remarkable ability to acquire meaningful representations for classification tasks without using semantic labels. This paper introduces a self-supervised learning framework suitable for hyperspectral images that are inherently challenging to annotate. The proposed framework architecture leverages cross-domain CNN, allowing for learning representations from different hyperspectral images with varying spectral characteristics and no pixel-level annotation. In the framework, cross-domain representations are learned via contrastive learning where neighboring spectral vectors in the same image are clustered together in a common representation space encompassing multiple hyperspectral images. In contrast, spectral vectors in different hyperspectral images are separated into distinct clusters in the space. To verify that the learned representation through contrastive learning is effectively transferred into a downstream task, we perform a classification task on hyperspectral images. The experimental results demonstrate the advantage of the proposed self-supervised representation over models trained from scratch or other transfer learning methods.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/02/2022

Mix-up Self-Supervised Learning for Contrast-agnostic Applications

Contrastive self-supervised learning has attracted significant research ...
research
09/19/2022

S^3R: Self-supervised Spectral Regression for Hyperspectral Histopathology Image Classification

Benefited from the rich and detailed spectral information in hyperspectr...
research
11/15/2021

Large-Scale Hyperspectral Image Clustering Using Contrastive Learning

Clustering of hyperspectral images is a fundamental but challenging task...
research
07/01/2019

Self-supervised Hyperspectral Image Restoration using Separable Image Prior

Supervised learning with a convolutional neural network is recognized as...
research
04/07/2022

Exploring Cross-Domain Pretrained Model for Hyperspectral Image Classification

A pretrain-finetune strategy is widely used to reduce the overfitting th...
research
09/08/2023

Representation Synthesis by Probabilistic Many-Valued Logic Operation in Self-Supervised Learning

Self-supervised learning (SSL) using mixed images has been studied to le...
research
01/09/2023

Nearest Neighbor-Based Contrastive Learning for Hyperspectral and LiDAR Data Classification

The joint hyperspectral image (HSI) and LiDAR data classification aims t...

Please sign up or login with your details

Forgot password? Click here to reset