A combined full-reference image quality assessment method based on convolutional activation maps

10/19/2020
by   Domonkos Varga, et al.
0

The goal of full-reference image quality assessment (FR-IQA) is to predict the quality of an image as perceived by human observers with using its pristine, reference counterpart. In this study, we explore a novel, combined approach which predicts the perceptual quality of a distorted image by compiling a feature vector from convolutional activation maps. More specifically, a reference-distorted image pair is run through a pretrained convolutional neural network and the activation maps are compared with a traditional image similarity metric. Subsequently, the resulted feature vector is mapped onto perceptual quality scores with the help of a trained support vector regressor. A detailed parameter study is also presented in which the design choices of the proposed method is reasoned. Furthermore, we study the relationship between the amount of training images and the prediction performance. Specifically, it is demonstrated that the proposed method can be trained with few amount of data to reach high prediction performance. Our best proposal - ActMapFeat - is compared to the state-of-the-art on six publicly available benchmark IQA databases, such as KADID-10k, TID2013, TID2008, MDID, CSIQ, and VCL-FER. Specifically, our method is able to significantly outperform the state-of-the-art on these benchmark databases. This paper is accompanied by the source code of the proposed method: https://github.com/Skythianos/FRIQA-ActMapFeat.

READ FULL TEXT

page 4

page 5

page 7

page 9

page 14

page 15

page 16

research
10/19/2020

Comprehensive evaluation of no-reference image quality assessment algorithms on KADID-10k database

The main goal of objective image quality assessment is to devise computa...
research
12/27/2018

No-Reference Color Image Quality Assessment: From Entropy to Perceptual Quality

This paper presents a high-performance general-purpose no-reference (NR)...
research
04/16/2020

Image Quality Assessment: Unifying Structure and Texture Similarity

Objective measures of image quality generally operate by making local co...
research
04/05/2018

Hallucinated-IQA: No-Reference Image Quality Assessment via Adversarial Learning

No-reference image quality assessment (NR-IQA) is a fundamental yet chal...
research
02/08/2020

Deep No-reference Tone Mapped Image Quality Assessment

The process of rendering high dynamic range (HDR) images to be viewed on...
research
05/22/2018

Aesthetics Assessment of Images Containing Faces

Recent research has widely explored the problem of aesthetics assessment...
research
11/14/2018

ReSIFT: Reliability-Weighted SIFT-based Image Quality Assessment

This paper presents a full-reference image quality estimator based on SI...

Please sign up or login with your details

Forgot password? Click here to reset