DeepAI AI Chat
Log In Sign Up

Exploring Cross-Domain Pretrained Model for Hyperspectral Image Classification

by   Hyungtae Lee, et al.
Booz Allen Hamilton Inc.

A pretrain-finetune strategy is widely used to reduce the overfitting that can occur when data is insufficient for CNN training. First few layers of a CNN pretrained on a large-scale RGB dataset are capable of acquiring general image characteristics which are remarkably effective in tasks targeted for different RGB datasets. However, when it comes down to hyperspectral domain where each domain has its unique spectral properties, the pretrain-finetune strategy no longer can be deployed in a conventional way while presenting three major issues: 1) inconsistent spectral characteristics among the domains (e.g., frequency range), 2) inconsistent number of data channels among the domains, and 3) absence of large-scale hyperspectral dataset. We seek to train a universal cross-domain model which can later be deployed for various spectral domains. To achieve, we physically furnish multiple inlets to the model while having a universal portion which is designed to handle the inconsistent spectral characteristics among different domains. Note that only the universal portion is used in the finetune process. This approach naturally enables the learning of our model on multiple domains simultaneously which acts as an effective workaround for the issue of the absence of large-scale dataset. We have carried out a study to extensively compare models that were trained using cross-domain approach with ones trained from scratch. Our approach was found to be superior both in accuracy and in training efficiency. In addition, we have verified that our approach effectively reduces the overfitting issue, enabling us to deepen the model up to 13 layers (from 9) without compromising the accuracy.


page 1

page 8


Cross-domain CNN for Hyperspectral Image Classification

In this paper, we address the dataset scarcity issue with the hyperspect...

Self-supervised Contrastive Learning for Cross-domain Hyperspectral Image Representation

Recently, self-supervised learning has attracted attention due to its re...

Boosting Deep Hyperspectral Image Classification with Spectral Unmixing

Recent advances in neural networks have made great progress in addressin...

Terrain Classification using Transfer Learning on Hyperspectral Images: A Comparative study

A Hyperspectral image contains much more number of channels as compared ...

Large-Scale Hate Speech Detection with Cross-Domain Transfer

The performance of hate speech detection models relies on the datasets o...

Domain Adaptor Networks for Hyperspectral Image Recognition

We consider the problem of adapting a network trained on three-channel c...