DeepAI AI Chat
Log In Sign Up

The Effect of Distortions on the Prediction of Visual Attention

by   Milind S. Gide, et al.

Existing saliency models have been designed and evaluated for predicting the saliency in distortion-free images. However, in practice, the image quality is affected by a host of factors at several stages of the image processing pipeline such as acquisition, compression and transmission. Several studies have explored the effect of distortion on human visual attention; however, none of them have considered the performance of visual saliency models in the presence of distortion. Furthermore, given that one potential application of visual saliency prediction is to aid pooling of objective visual quality metrics, it is important to compare the performance of existing saliency models on distorted images. In this paper, we evaluate several state-of-the-art visual attention models over different databases consisting of distorted images with various types of distortions such as blur, noise and compression with varying levels of distortion severity. This paper also introduces new improved performance evaluation metrics that are shown to overcome shortcomings in existing performance metrics. We find that the performance of most models improves with moderate and high levels of distortions as compared to the near distortion-free case. In addition, model performance is also found to decrease with an increase in image complexity.


page 5

page 6

page 7

page 8

page 9

page 11

page 14


A Locally Weighted Fixation Density-Based Metric for Assessing the Quality of Visual Saliency Predictions

With the increased focus on visual attention (VA) in the last decade, a ...

Center Emphasized Visual Saliency and Contrast-based Full Reference Image Quality Index

Objective Image Quality Assessment (IQA) is imperative in this multimedi...

SID4VAM: A Benchmark Dataset with Synthetic Images for Visual Attention Modeling

A benchmark of saliency models performance with a synthetic image datase...

Improving Video Compression With Deep Visual-Attention Models

Recent advances in deep learning have markedly improved the quality of v...

Invariance Analysis of Saliency Models versus Human Gaze During Scene Free Viewing

Most of current studies on human gaze and saliency modeling have used hi...

The First Comprehensive Dataset with Multiple Distortion Types for Visual Just-Noticeable Differences

Recently, with the development of deep learning, a number of Just Notice...

Predicting Eye Fixations Under Distortion Using Bayesian Observers

Visual attention is very an essential factor that affects how human perc...