Deep Optimization model for Screen Content Image Quality Assessment using Neural Networks

03/02/2019
by   Xuhao Jiang, et al.
8

In this paper, we propose a novel quadratic optimized model based on the deep convolutional neural network (QODCNN) for full-reference and no-reference screen content image (SCI) quality assessment. Unlike traditional CNN methods taking all image patches as training data and using average quality pooling, our model is optimized to obtain a more effective model including three steps. In the first step, an end-to-end deep CNN is trained to preliminarily predict the image visual quality, and batch normalized (BN) layers and l2 regularization are employed to improve the speed and performance of network fitting. For second step, the pretrained model is fine-tuned to achieve better performance under analysis of the raw training data. An adaptive weighting method is proposed in the third step to fuse local quality inspired by the perceptual property of the human visual system (HVS) that the HVS is sensitive to image patches containing texture and edge information. The novelty of our algorithm can be concluded as follows: 1) with the consideration of correlation between local quality and subjective differential mean opinion score (DMOS), the Euclidean distance is utilized to measure effectiveness of image patches, and the pretrained model is fine-tuned with more effective training data; 2) an adaptive pooling approach is employed to fuse patch quality of textual and pictorial regions, whose feature only extracted from distorted images owns strong noise robust and effects on both FR and NR IQA; 3) Considering the characteristics of SCIs, a deep and valid network architecture is designed for both NR and FR visual quality evaluation of SCIs. Experimental results verify that our model outperforms both current no-reference and full-reference image quality assessment methods on the benchmark screen content image quality assessment database (SIQAD).

READ FULL TEXT

page 1

page 3

page 5

page 6

page 7

research
02/17/2016

On the Use of Deep Learning for Blind Image Quality Assessment

In this work we investigate the use of deep learning for distortion-gene...
research
09/22/2016

Deep Quality: A Deep No-reference Quality Assessment System

Image quality assessment (IQA) continues to garner great interest in the...
research
02/27/2023

Mask Reference Image Quality Assessment

Understanding semantic information is an essential step in knowing what ...
research
06/09/2022

Deep Neural Network for Blind Visual Quality Assessment of 4K Content

The 4K content can deliver a more immersive visual experience to consume...
research
11/19/2021

Neural Image Beauty Predictor Based on Bradley-Terry Model

Image beauty assessment is an important subject of computer vision. Ther...
research
09/15/2017

NIMA: Neural Image Assessment

Automatically learned quality assessment for images has recently become ...
research
04/14/2020

Towards Robust Classification with Image Quality Assessment

Recent studies have shown that deep convolutional neural networks (DCNN)...

Please sign up or login with your details

Forgot password? Click here to reset