Blind Quality Assessment for Image Superresolution Using Deep Two-Stream Convolutional Networks

04/13/2020
by   Wei Zhou, et al.
3

Numerous image superresolution (SR) algorithms have been proposed for reconstructing high-resolution (HR) images from input images with lower spatial resolutions. However, effectively evaluating the perceptual quality of SR images remains a challenging research problem. In this paper, we propose a no-reference/blind deep neural network-based SR image quality assessor (DeepSRQ). To learn more discriminative feature representations of various distorted SR images, the proposed DeepSRQ is a two-stream convolutional network including two subcomponents for distorted structure and texture SR images. Different from traditional image distortions, the artifacts of SR images cause both image structure and texture quality degradation. Therefore, we choose the two-stream scheme that captures different properties of SR inputs instead of directly learning features from one image stream. Considering the human visual system (HVS) characteristics, the structure stream focuses on extracting features in structural degradations, while the texture stream focuses on the change in textural distributions. In addition, to augment the training data and ensure the category balance, we propose a stride-based adaptive cropping approach for further improvement. Experimental results on three publicly available SR image quality databases demonstrate the effectiveness and generalization ability of our proposed DeepSRQ method compared with state-of-the-art image quality assessment algorithms.

READ FULL TEXT

page 6

page 8

page 21

page 23

research
07/19/2023

Blind Image Quality Assessment Using Multi-Stream Architecture with Spatial and Channel Attention

BIQA (Blind Image Quality Assessment) is an important field of study tha...
research
05/27/2022

Textural-Structural Joint Learning for No-Reference Super-Resolution Image Quality Assessment

Image super-resolution (SR) has been widely investigated in recent years...
research
07/15/2022

Quality Assessment of Image Super-Resolution: Balancing Deterministic and Statistical Fidelity

There has been a growing interest in developing image super-resolution (...
research
09/04/2019

Predictive Auto-Encoding Network for Blind Stereoscopic Image Quality Assessment

Stereoscopic image quality assessment (SIQA) has encountered non-trivial...
research
07/06/2023

RefVSR++: Exploiting Reference Inputs for Reference-based Video Super-resolution

Smartphones equipped with a multi-camera system comprising multiple came...
research
04/16/2020

Image Quality Assessment: Unifying Structure and Texture Similarity

Objective measures of image quality generally operate by making local co...

Please sign up or login with your details

Forgot password? Click here to reset