Confusing Image Quality Assessment: Towards Better Augmented Reality Experience

04/11/2022
by   Huiyu Duan, et al.
0

With the development of multimedia technology, Augmented Reality (AR) has become a promising next-generation mobile platform. The primary value of AR is to promote the fusion of digital contents and real-world environments, however, studies on how this fusion will influence the Quality of Experience (QoE) of these two components are lacking. To achieve better QoE of AR, whose two layers are influenced by each other, it is important to evaluate its perceptual quality first. In this paper, we consider AR technology as the superimposition of virtual scenes and real scenes, and introduce visual confusion as its basic theory. A more general problem is first proposed, which is evaluating the perceptual quality of superimposed images, i.e., confusing image quality assessment. A ConFusing Image Quality Assessment (CFIQA) database is established, which includes 600 reference images and 300 distorted images generated by mixing reference images in pairs. Then a subjective quality perception study and an objective model evaluation experiment are conducted towards attaining a better understanding of how humans perceive the confusing images. An objective metric termed CFIQA is also proposed to better evaluate the confusing image quality. Moreover, an extended ARIQA study is further conducted based on the CFIQA study. We establish an ARIQA database to better simulate the real AR application scenarios, which contains 20 AR reference images, 20 background (BG) reference images, and 560 distorted images generated from AR and BG references, as well as the correspondingly collected subjective quality ratings. We also design three types of full-reference (FR) IQA metrics to study whether we should consider the visual confusion when designing corresponding IQA algorithms. An ARIQA metric is finally proposed for better evaluating the perceptual quality of AR images.

READ FULL TEXT

page 1

page 3

page 4

page 8

page 9

page 12

research
04/18/2022

Saliency in Augmented Reality

With the rapid development of multimedia technology, Augmented Reality (...
research
07/06/2022

Perceptual Quality Assessment of Omnidirectional Images

Omnidirectional images and videos can provide immersive experience of re...
research
05/02/2017

Towards Predictions of the Image Quality of Experience for Augmented Reality Scenarios

Augmented Reality (AR) devices are commonly head-worn to overlay context...
research
05/29/2023

Towards a Robust Framework for NeRF Evaluation

Neural Radiance Field (NeRF) research has attracted significant attentio...
research
01/21/2019

Hybrid Design Tools - Image Quality Assessment of a Digitally Augmented Blackboard Integrated System

In the last two decades, Interactive White Boards (IWBs) have been widel...
research
04/10/2019

Image Quality Assessment for Omnidirectional Cross-reference Stitching

Along with the development of virtual reality (VR), omnidirectional imag...
research
05/15/2017

A Perceptually Weighted Rank Correlation Indicator for Objective Image Quality Assessment

In the field of objective image quality assessment (IQA), the Spearman's...

Please sign up or login with your details

Forgot password? Click here to reset