Exploiting Digital Surface Models for Inferring Super-Resolution for Remotely Sensed Images

05/09/2022
by   Savvas Karatsiolis, et al.
3

Despite the plethora of successful Super-Resolution Reconstruction (SRR) models applied to natural images, their application to remote sensing imagery tends to produce poor results. Remote sensing imagery is often more complicated than natural images and has its peculiarities such as being of lower resolution, it contains noise, and often depicting large textured surfaces. As a result, applying non-specialized SRR models on remote sensing imagery results in artifacts and poor reconstructions. To address these problems, this paper proposes an architecture inspired by previous research work, introducing a novel approach for forcing an SRR model to output realistic remote sensing images: instead of relying on feature-space similarities as a perceptual loss, the model considers pixel-level information inferred from the normalized Digital Surface Model (nDSM) of the image. This strategy allows the application of better-informed updates during the training of the model which sources from a task (elevation map inference) that is closely related to remote sensing. Nonetheless, the nDSM auxiliary information is not required during production and thus the model infers a super-resolution image without any additional data besides its low-resolution pairs. We assess our model on two remotely sensed datasets of different spatial resolutions that also contain the DSM pairs of the images: the DFC2018 dataset and the dataset containing the national Lidar fly-by of Luxembourg. Based on visual inspection, the inferred super-resolution images exhibit particularly superior quality. In particular, the results for the high-resolution DFC2018 dataset are realistic and almost indistinguishable from the ground truth images.

READ FULL TEXT

page 1

page 3

page 4

page 6

page 7

page 8

page 9

research
11/05/2021

Multi-Spectral Multi-Image Super-Resolution of Sentinel-2 with Radiometric Consistency Losses and Its Effect on Building Delineation

High resolution remote sensing imagery is used in broad range of tasks, ...
research
04/07/2017

Locally-adapted convolution-based super-resolution of irregularly-sampled ocean remote sensing data

Super-resolution is a classical problem in image processing, with numero...
research
07/06/2023

Multi-source imagery fusion using deep learning in a cloud computing platform

Given the high availability of data collected by different remote sensin...
research
09/03/2023

RSDiff: Remote Sensing Image Generation from Text Using Diffusion Model

Satellite imagery generation and super-resolution are pivotal tasks in r...
research
11/15/2021

On the validation of pansharpening methods

Validation of the quality of pansharpening methods is a difficult task b...
research
04/08/2020

Monte-Carlo Siamese Policy on Actor for Satellite Image Super Resolution

In the past few years supervised and adversarial learning have been wide...
research
05/26/2021

Permutation invariance and uncertainty in multitemporal image super-resolution

Recent advances have shown how deep neural networks can be extremely eff...

Please sign up or login with your details

Forgot password? Click here to reset