Re-IQA: Unsupervised Learning for Image Quality Assessment in the Wild

by   Avinab Saha, et al.

Automatic Perceptual Image Quality Assessment is a challenging problem that impacts billions of internet, and social media users daily. To advance research in this field, we propose a Mixture of Experts approach to train two separate encoders to learn high-level content and low-level image quality features in an unsupervised setting. The unique novelty of our approach is its ability to generate low-level representations of image quality that are complementary to high-level features representing image content. We refer to the framework used to train the two encoders as Re-IQA. For Image Quality Assessment in the Wild, we deploy the complementary low and high-level image representations obtained from the Re-IQA framework to train a linear regression model, which is used to map the image representations to the ground truth quality scores, refer Figure 1. Our method achieves state-of-the-art performance on multiple large-scale image quality assessment databases containing both real and synthetic distortions, demonstrating how deep neural networks can be trained in an unsupervised setting to produce perceptually relevant representations. We conclude from our experiments that the low and high-level features obtained are indeed complementary and positively impact the performance of the linear regressor. A public release of all the codes associated with this work will be made available on GitHub.


page 2

page 3

page 5

page 10

page 11

page 12

page 13


Exploiting High-Level Semantics for No-Reference Image Quality Assessment of Realistic Blur Images

To guarantee a satisfying Quality of Experience (QoE) for consumers, it ...

Blind Quality Assessment for in-the-Wild Images via Hierarchical Feature Fusion and Iterative Mixed Database Training

Image quality assessment (IQA) is very important for both end-users and ...

Image Quality Assessment using Contrastive Learning

We consider the problem of obtaining image quality representations in a ...

Local Distortion Aware Efficient Transformer Adaptation for Image Quality Assessment

Image Quality Assessment (IQA) constitutes a fundamental task within the...

Analysis of XLS-R for Speech Quality Assessment

In online conferencing applications, estimating the perceived quality of...

Towards Top-Down Stereoscopic Image Quality Assessment via Stereo Attention

Stereoscopic image quality assessment (SIQA) plays a crucial role in eva...

A Color Intensity Invariant Low Level Feature Optimization Framework for Image Quality Assessment

Image Quality Assessment (IQA) algorithms evaluate the perceptual qualit...

Please sign up or login with your details

Forgot password? Click here to reset