The Effect of Distortions on the Prediction of Visual Attention

04/13/2016
by   Milind S. Gide, et al.
0

Existing saliency models have been designed and evaluated for predicting the saliency in distortion-free images. However, in practice, the image quality is affected by a host of factors at several stages of the image processing pipeline such as acquisition, compression and transmission. Several studies have explored the effect of distortion on human visual attention; however, none of them have considered the performance of visual saliency models in the presence of distortion. Furthermore, given that one potential application of visual saliency prediction is to aid pooling of objective visual quality metrics, it is important to compare the performance of existing saliency models on distorted images. In this paper, we evaluate several state-of-the-art visual attention models over different databases consisting of distorted images with various types of distortions such as blur, noise and compression with varying levels of distortion severity. This paper also introduces new improved performance evaluation metrics that are shown to overcome shortcomings in existing performance metrics. We find that the performance of most models improves with moderate and high levels of distortions as compared to the near distortion-free case. In addition, model performance is also found to decrease with an increase in image complexity.

READ FULL TEXT

page 5

page 6

page 7

page 8

page 9

page 11

page 14

research
08/01/2017

A Locally Weighted Fixation Density-Based Metric for Assessing the Quality of Visual Saliency Predictions

With the increased focus on visual attention (VA) in the last decade, a ...
research
12/28/2018

Center Emphasized Visual Saliency and Contrast-based Full Reference Image Quality Index

Objective Image Quality Assessment (IQA) is imperative in this multimedi...
research
10/29/2019

SID4VAM: A Benchmark Dataset with Synthetic Images for Visual Attention Modeling

A benchmark of saliency models performance with a synthetic image datase...
research
03/19/2019

Improving Video Compression With Deep Visual-Attention Models

Recent advances in deep learning have markedly improved the quality of v...
research
10/10/2018

Invariance Analysis of Saliency Models versus Human Gaze During Scene Free Viewing

Most of current studies on human gaze and saliency modeling have used hi...
research
03/05/2023

The First Comprehensive Dataset with Multiple Distortion Types for Visual Just-Noticeable Differences

Recently, with the development of deep learning, a number of Just Notice...
research
02/06/2021

Predicting Eye Fixations Under Distortion Using Bayesian Observers

Visual attention is very an essential factor that affects how human perc...

Please sign up or login with your details

Forgot password? Click here to reset