No-reference Quality Assessment with Unsupervised Domain Adaptation

08/19/2020
by   Baoliang Chen, et al.
0

Quality assessment driven by machine learning generally relies on the strong assumption that the training and testing data share very close scene statistics, lacking the adaptation capacity to the content in other domains. In this paper, we quest the capability of transferring the quality of natural scene to the images that are not acquired by optical cameras (e.g., screen content images, SCIs), rooted in the widely accepted view that the human visual system has adapted and evolved through the perception of natural environment. Here we develop the first unsupervised domain adaptation based no reference quality assessment method, under the reasonable assumption that there are abundant subjective ratings of natural images (NIs). In general, it is a non-trivial task to directly transfer the quality prediction model from NIs to a new type of content (i.e., SCIs) that holds dramatically different statistical characteristics. Inspired by the transferability of pair-wise relationship, the proposed quality measure operates based on the philosophy of learning to rank. To reduce the domain gap, we introduce two complementary losses which explicitly regularize the feature space of ranking in a progressive manner. For feature discrepancy minimization, the maximum mean discrepancy (MMD) is imposed on the extracted ranking features of NIs and SCIs. For feature discriminatory capability enhancement, we propose a center based loss to rectify the classifier and improve its prediction capability not only for source domain (NI) but also the target domain (SCI). Experiments show that our method can achieve higher performance on different source-target settings based on a light-weight convolution neural network. The proposed method also sheds light on learning quality assessment measures for unseen application-specific content without the cumbersome and costing subjective evaluations.

READ FULL TEXT

page 1

page 3

page 4

research
12/06/2021

No-Reference Point Cloud Quality Assessment via Domain Adaptation

We present a novel no-reference quality assessment metric, the image tra...
research
10/19/2022

Deep-based quality assessment of medical images through domain adaptation

Predicting the quality of multimedia content is often needed in differen...
research
07/29/2022

StyleAM: Perception-Oriented Unsupervised Domain Adaption for Non-reference Image Quality Assessment

Deep neural networks (DNNs) have shown great potential in non-reference ...
research
03/11/2013

Linear NDCG and Pair-wise Loss

Linear NDCG is used for measuring the performance of the Web content qua...
research
07/17/2022

Source-free Unsupervised Domain Adaptation for Blind Image Quality Assessment

Existing learning-based methods for blind image quality assessment (BIQA...
research
06/18/2021

Debiased Subjective Assessment of Real-World Image Enhancement

In real-world image enhancement, it is often challenging (if not impossi...

Please sign up or login with your details

Forgot password? Click here to reset