A Comparison of Super-Resolution and Nearest Neighbors Interpolation Applied to Object Detection on Satellite Data

07/08/2019
by   Evan Koester, et al.
0

As Super-Resolution (SR) has matured as a research topic, it has been applied to additional topics beyond image reconstruction. In particular, combining classification or object detection tasks with a super-resolution preprocessing stage has yielded improvements in accuracy especially with objects that are small relative to the scene. While SR has shown promise, a study comparing SR and naive upscaling methods such as Nearest Neighbors (NN) interpolation when applied as a preprocessing step for object detection has not been performed. We apply the topic to satellite data and compare the Multi-scale Deep Super-Resolution (MDSR) system to NN on the xView challenge dataset. To do so, we propose a pipeline for processing satellite data that combines multi-stage image tiling and upscaling, the YOLOv2 object detection architecture, and label stitching. We compare the effects of training models using an upscaling factor of 4, upscaling images from 30cm Ground Sample Distance (GSD) to an effective GSD of 7.5cm. Upscaling by this factor significantly improves detection results, increasing Average Precision (AP) of a generalized vehicle class by 23 percent. We demonstrate that while SR produces upscaled images that are more visually pleasing than their NN counterparts, object detection networks see little difference in accuracy with images upsampled using NN obtaining nearly identical results to the MDSRx4 enhanced images with a difference of 0.0002 AP between the two methods.

READ FULL TEXT

page 1

page 3

page 4

page 6

research
08/08/2023

When Super-Resolution Meets Camouflaged Object Detection: A Comparison Study

Super Resolution (SR) and Camouflaged Object Detection (COD) are two hot...
research
03/30/2018

Task-Driven Super Resolution: Object Detection in Low-resolution Images

We consider how image super resolution (SR) can contribute to an object ...
research
03/10/2021

Super-Resolving Beyond Satellite Hardware Using Realistically Degraded Images

Modern deep Super-Resolution (SR) networks have established themselves a...
research
12/10/2018

The Effects of Super-Resolution on Object Detection Performance in Satellite Imagery

We explore the application of super-resolution techniques to satellite i...
research
11/04/2020

Physics-Informed Neural Network Super Resolution for Advection-Diffusion Models

Physics-informed neural networks (NN) are an emerging technique to impro...
research
09/27/2022

SuperYOLO: Super Resolution Assisted Object Detection in Multimodal Remote Sensing Imagery

In this paper, we propose an accurate yet fast small object detection me...

Please sign up or login with your details

Forgot password? Click here to reset