Reducing Effects of Swath Gaps on Unsupervised Machine Learning Models for NASA MODIS Instruments

06/13/2021
by   Sarah Chen, et al.
26

Due to the nature of their pathways, NASA Terra and NASA Aqua satellites capture imagery containing swath gaps, which are areas of no data. Swath gaps can overlap the region of interest (ROI) completely, often rendering the entire imagery unusable by Machine Learning (ML) models. This problem is further exacerbated when the ROI rarely occurs (e.g. a hurricane) and, on occurrence, is partially overlapped with a swath gap. With annotated data as supervision, a model can learn to differentiate between the area of focus and the swath gap. However, annotation is expensive and currently the vast majority of existing data is unannotated. Hence, we propose an augmentation technique that considerably removes the existence of swath gaps in order to allow CNNs to focus on the ROI, and thus successfully use data with swath gaps for training. We experiment on the UC Merced Land Use Dataset, where we add swath gaps through empty polygons (up to 20 percent areas) and then apply augmentation techniques to fill the swath gaps. We compare the model trained with our augmentation techniques on the swath gap-filled data with the model trained on the original swath gap-less data and note highly augmented performance. Additionally, we perform a qualitative analysis using activation maps that visualizes the effectiveness of our trained network in not paying attention to the swath gaps. We also evaluate our results with a human baseline and show that, in certain cases, the filled swath gaps look so realistic that even a human evaluator did not distinguish between original satellite images and swath gap-filled images. Since this method is aimed at unlabeled data, it is widely generalizable and impactful for large scale unannotated datasets from various space data domains.

READ FULL TEXT

page 2

page 3

page 4

page 7

page 8

page 9

page 10

page 11

research
07/07/2021

Scalable Data Balancing for Unlabeled Satellite Imagery

Data imbalance is a ubiquitous problem in machine learning. In large sca...
research
06/26/2022

Towards a Tighter Bound on Possible-Rendezvous Areas: Preliminary Results

Given trajectories with gaps, we investigate methods to tighten spatial ...
research
03/01/2021

Automated data-driven approach for gap filling in the time series using evolutionary learning

Time series analysis is widely used in various fields of science and ind...
research
04/09/2022

Segmenting across places: The need for fair transfer learning with satellite imagery

The increasing availability of high-resolution satellite imagery has ena...
research
08/10/2023

Are We Closing the Loop Yet? Gaps in the Generalizability of VIS4ML Research

Visualization for machine learning (VIS4ML) research aims to help expert...
research
04/21/2022

Understanding the Domain Gap in LiDAR Object Detection Networks

In order to make autonomous driving a reality, artificial neural network...
research
11/24/2017

Predicting shim gaps in aircraft assembly with machine learning and sparse sensing

A modern aircraft may require on the order of thousands of custom shims ...

Please sign up or login with your details

Forgot password? Click here to reset