Towards a Semantic Perceptual Image Metric

08/01/2018
by   Troy Chinen, et al.
0

We present a full reference, perceptual image metric based on VGG-16, an artificial neural network trained on object classification. We fit the metric to a new database based on 140k unique images annotated with ground truth by human raters who received minimal instruction. The resulting metric shows competitive performance on TID 2013, a database widely used to assess image quality assessments methods. More interestingly, it shows strong responses to objects potentially carrying semantic relevance such as faces and text, which we demonstrate using a visualization technique and ablation experiments. In effect, the metric appears to model a higher influence of semantic context on judgments, which we observe particularly in untrained raters. As the vast majority of users of image processing systems are unfamiliar with Image Quality Assessment (IQA) tasks, these findings may have significant impact on real-world applications of perceptual metrics.

READ FULL TEXT

page 1

page 3

page 4

research
02/17/2022

A study of deep perceptual metrics for image quality assessment

Several metrics exist to quantify the similarity between images, but the...
research
12/07/2017

Learned Perceptual Image Enhancement

Learning a typical image enhancement pipeline involves minimization of a...
research
12/20/2017

Blind High Dynamic Range Quality estimation by disentangling perceptual and noise features in images

Assessing the visual quality of High Dynamic Range (HDR) images is an un...
research
03/01/2021

Deep Perceptual Image Quality Assessment for Compression

Lossy Image compression is necessary for efficient storage and transfer ...
research
11/22/2018

Image Quality Assessment and Color Difference

An average healthy person does not perceive the world in just black and ...
research
07/27/2022

Shift-tolerant Perceptual Similarity Metric

Existing perceptual similarity metrics assume an image and its reference...
research
06/11/2020

An Unsupervised Information-Theoretic Perceptual Quality Metric

Tractable models of human perception have proved to be challenging to bu...

Please sign up or login with your details

Forgot password? Click here to reset