The Effect of Distortions on the Prediction of Visual Attention

by   Milind S. Gide, et al.

Existing saliency models have been designed and evaluated for predicting the saliency in distortion-free images. However, in practice, the image quality is affected by a host of factors at several stages of the image processing pipeline such as acquisition, compression and transmission. Several studies have explored the effect of distortion on human visual attention; however, none of them have considered the performance of visual saliency models in the presence of distortion. Furthermore, given that one potential application of visual saliency prediction is to aid pooling of objective visual quality metrics, it is important to compare the performance of existing saliency models on distorted images. In this paper, we evaluate several state-of-the-art visual attention models over different databases consisting of distorted images with various types of distortions such as blur, noise and compression with varying levels of distortion severity. This paper also introduces new improved performance evaluation metrics that are shown to overcome shortcomings in existing performance metrics. We find that the performance of most models improves with moderate and high levels of distortions as compared to the near distortion-free case. In addition, model performance is also found to decrease with an increase in image complexity.



There are no comments yet.


page 5

page 6

page 7

page 8

page 9

page 11

page 14


A Locally Weighted Fixation Density-Based Metric for Assessing the Quality of Visual Saliency Predictions

With the increased focus on visual attention (VA) in the last decade, a ...

Center Emphasized Visual Saliency and Contrast-based Full Reference Image Quality Index

Objective Image Quality Assessment (IQA) is imperative in this multimedi...

SID4VAM: A Benchmark Dataset with Synthetic Images for Visual Attention Modeling

A benchmark of saliency models performance with a synthetic image datase...

Invariance Analysis of Saliency Models versus Human Gaze During Scene Free Viewing

Most of current studies on human gaze and saliency modeling have used hi...

Residual Networks based Distortion Classification and Ranking for Laparoscopic Image Quality Assessment

Laparoscopic images and videos are often affected by different types of ...

SALYPATH: A Deep-Based Architecture for visual attention prediction

Human vision is naturally more attracted by some regions within their fi...

Cube Padding for Weakly-Supervised Saliency Prediction in 360° Videos

Automatic saliency prediction in 360 videos is critical for viewpoint gu...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.