SATIN: A Multi-Task Metadataset for Classifying Satellite Imagery using Vision-Language Models

04/23/2023
by   Jonathan Roberts, et al.
0

Interpreting remote sensing imagery enables numerous downstream applications ranging from land-use planning to deforestation monitoring. Robustly classifying this data is challenging due to the Earth's geographic diversity. While many distinct satellite and aerial image classification datasets exist, there is yet to be a benchmark curated that suitably covers this diversity. In this work, we introduce SATellite ImageNet (SATIN), a metadataset curated from 27 existing remotely sensed datasets, and comprehensively evaluate the zero-shot transfer classification capabilities of a broad range of vision-language (VL) models on SATIN. We find SATIN to be a challenging benchmark-the strongest method we evaluate achieves a classification accuracy of 52.0 leaderboardto guide and track the progress of VL models in this important domain.

READ FULL TEXT

page 5

page 16

page 17

page 18

page 19

page 22

research
10/13/2022

Evaluating the Label Efficiency of Contrastive Self-Supervised Learning for Multi-Resolution Satellite Imagery

The application of deep neural networks to remote sensing imagery is oft...
research
07/17/2022

SatMAE: Pre-training Transformers for Temporal and Multi-Spectral Satellite Imagery

Unsupervised pre-training methods for large vision models have shown to ...
research
09/11/2015

DeepSat - A Learning framework for Satellite Imagery

Satellite image classification is a challenging problem that lies at the...
research
11/17/2021

TorchGeo: deep learning with geospatial data

Remotely sensed geospatial data are critical for applications including ...
research
10/12/2020

Spectral Synthesis for Satellite-to-Satellite Translation

Earth observing satellites carrying multi-spectral sensors are widely us...
research
04/27/2023

A Method for Classifying Snow Using Ski-Mounted Strain Sensors

Understanding the structure, quantity, and type of snow in mountain land...
research
02/08/2021

Overhead MNIST: A Benchmark Satellite Dataset

The research presents an overhead view of 10 important objects and follo...

Please sign up or login with your details

Forgot password? Click here to reset