Learning Local Distortion Visibility From Image Quality Data-sets

Accurate prediction of local distortion visibility thresholds is critical in many image and video processing applications. Existing methods require an accurate modeling of the human visual system, and are derived through pshycophysical experiments with simple, artificial stimuli. These approaches, however, are difficult to generalize to natural images with complex types of distortion. In this paper, we explore a different perspective, and we investigate whether it is possible to learn local distortion visibility from image quality scores. We propose a convolutional neural network based optimization framework to infer local detection thresholds in a distorted image. Our model is trained on multiple quality datasets, and the results are correlated with empirical visibility thresholds collected on complex stimuli in a recent study. Our results are comparable to state-of-the-art mathematical models that were trained on phsycovisual data directly. This suggests that it is possible to predict psychophysical phenomena from visibility information embedded in image quality scores.

READ FULL TEXT
research
08/04/2022

Image Quality Assessment: Learning to Rank Image Distortion Level

Over the years, various algorithms were developed, attempting to imitate...
research
05/31/2023

Enhancing image quality prediction with self-supervised visual masking

Full-reference image quality metrics (FR-IQMs) aim to measure the visual...
research
12/13/2019

Learning to Observe: Approximating Human Perceptual Thresholds for Detection of Suprathreshold Image Transformations

Many tasks in computer vision are often calibrated and evaluated relativ...
research
08/11/2021

Towards Top-Down Just Noticeable Difference Estimation of Natural Images

Existing efforts on Just noticeable difference (JND) estimation mainly d...
research
12/17/2014

Full-reference image quality assessment by combining global and local distortion measures

Full-reference image quality assessment (FR-IQA) techniques compare a re...
research
10/06/2017

Eigen-Distortions of Hierarchical Representations

We develop a method for comparing hierarchical image representations in ...
research
01/29/2015

Structural Similarity Index SSIMplified: Is there really a simpler concept at the heart of image quality measurement?

The Structural Similarity Index (SSIM) is generally considered to be a m...

Please sign up or login with your details

Forgot password? Click here to reset