QMRNet: Quality Metric Regression for EO Image Quality Assessment and Super-Resolution

10/12/2022
by   David Berga, et al.
0

Latest advances in Super-Resolution (SR) have been tested with general purpose images such as faces, landscapes and objects, mainly unused for the task of super-resolving Earth Observation (EO) images. In this research paper, we benchmark state-of-the-art SR algorithms for distinct EO datasets using both Full-Reference and No-Reference Image Quality Assessment (IQA) metrics. We also propose a novel Quality Metric Regression Network (QMRNet) that is able to predict quality (as a No-Reference metric) by training on any property of the image (i.e. its resolution, its distortions...) and also able to optimize SR algorithms for a specific metric objective. This work is part of the implementation of the framework IQUAFLOW which has been developed for evaluating image quality, detection and classification of objects as well as image compression in EO use cases. We integrated our experimentation and tested our QMRNet algorithm on predicting features like blur, sharpness, snr, rer and ground sampling distance (GSD) and obtain validation medRs below 1.0 (out of N=50) and recall rates above 95%. Overall benchmark shows promising results for LIIF, CAR and MSRN and also the potential use of QMRNet as Loss for optimizing SR predictions. Due to its simplicity, QMRNet could also be used for other use cases and image domains, as its architecture and data processing is fully scalable.

READ FULL TEXT

page 17

page 18

page 19

page 20

page 26

page 27

page 28

page 29

research
05/08/2023

Compressed Video Quality Assessment for Super-Resolution: a Benchmark and a Quality Metric

We developed a super-resolution (SR) benchmark to analyze SR's capacity ...
research
06/04/2023

Scale Guided Hypernetwork for Blind Super-Resolution Image Quality Assessment

With the emergence of image super-resolution (SR) algorithm, how to blin...
research
07/15/2022

Quality Assessment of Image Super-Resolution: Balancing Deterministic and Statistical Fidelity

There has been a growing interest in developing image super-resolution (...
research
05/27/2022

Textural-Structural Joint Learning for No-Reference Super-Resolution Image Quality Assessment

Image super-resolution (SR) has been widely investigated in recent years...
research
03/25/2021

Zero-shot super-resolution with a physically-motivated downsampling kernel for endomicroscopy

Super-resolution (SR) methods have seen significant advances thanks to t...
research
03/16/2022

Towards True Detail Restoration for Super-Resolution: A Benchmark and a Quality Metric

Super-resolution (SR) has become a widely researched topic in recent yea...
research
11/29/2019

Learning from Irregularly Sampled Data for Endomicroscopy Super-resolution: A Comparative Study of Sparse and Dense Approaches

Purpose: Probe-based Confocal Laser Endomicroscopy (pCLE) enables perfor...

Please sign up or login with your details

Forgot password? Click here to reset