Learning from Mixed Datasets: A Monotonic Image Quality Assessment Model

09/21/2022
by   Zhaopeng Feng, et al.
0

Deep learning based image quality assessment (IQA) models usually learn to predict image quality from a single dataset, leading the model to overfit specific scenes. To account for this, mixed datasets training can be an effective way to enhance the generalization capability of the model. However, it is nontrivial to combine different IQA datasets, as their quality evaluation criteria, score ranges, view conditions, as well as subjects are usually not shared during the image quality annotation. In this paper, instead of aligning the annotations, we propose a monotonic neural network for IQA model learning with different datasets combined. In particular, our model consists of a dataset-shared quality regressor and several dataset-specific quality transformers. The quality regressor aims to obtain the perceptual qualities of each dataset while each quality transformer maps the perceptual qualities to the corresponding dataset annotations with their monotonicity maintained. The experimental results verify the effectiveness of the proposed learning strategy and our code is available at https://github.com/fzp0424/MonotonicIQA.

READ FULL TEXT

page 1

page 2

research
04/20/2022

Multi-Scale Features and Parallel Transformers Based Image Quality Assessment

With the increase in multimedia content, the type of distortions associa...
research
04/12/2023

An Image Quality Assessment Dataset for Portraits

Year after year, the demand for ever-better smartphone photos continues ...
research
09/07/2023

Perceptual Quality Assessment of 360^∘ Images Based on Generative Scanpath Representation

Despite substantial efforts dedicated to the design of heuristic models ...
research
12/31/2021

Disjoint Contrastive Regression Learning for Multi-Sourced Annotations

Large-scale datasets are important for the development of deep learning ...
research
08/28/2017

A Probabilistic Quality Representation Approach to Deep Blind Image Quality Prediction

Blind image quality assessment (BIQA) remains a very challenging problem...
research
10/25/2021

Image Quality Assessment using Contrastive Learning

We consider the problem of obtaining image quality representations in a ...

Please sign up or login with your details

Forgot password? Click here to reset