Blind Surveillance Image Quality Assessment via Deep Neural Network Combined with the Visual Saliency

06/09/2022
by   Wei Lu, et al.
0

The intelligent video surveillance system (IVSS) can automatically analyze the content of the surveillance image (SI) and reduce the burden of the manual labour. However, the SIs may suffer quality degradations in the procedure of acquisition, compression, and transmission, which makes IVSS hard to understand the content of SIs. In this paper, we first conduct an example experiment (i.e. the face detection task) to demonstrate that the quality of the SIs has a crucial impact on the performance of the IVSS, and then propose a saliency-based deep neural network for the blind quality assessment of the SIs, which helps IVSS to filter the low-quality SIs and improve the detection and recognition performance. Specifically, we first compute the saliency map of the SI to select the most salient local region since the salient regions usually contain rich semantic information for machine vision and thus have a great impact on the overall quality of the SIs. Next, the convolutional neural network (CNN) is adopted to extract quality-aware features for the whole image and local region, which are then mapped into the global and local quality scores through the fully connected (FC) network respectively. Finally, the overall quality score is computed as the weighted sum of the global and local quality scores. Experimental results on the SI quality database (SIQD) show that the proposed method outperforms all compared state-of-the-art BIQA methods.

READ FULL TEXT

page 2

page 8

research
06/09/2022

Deep Neural Network for Blind Visual Quality Assessment of 4K Content

The 4K content can deliver a more immersive visual experience to consume...
research
08/22/2017

Contrast and visual saliency similarity induced index for image quality assessment

Perceptual image quality assessment (IQA) defines/utilizes a computation...
research
02/24/2023

Blind Omnidirectional Image Quality Assessment: Integrating Local Statistics and Global Semantics

Omnidirectional image quality assessment (OIQA) aims to predict the perc...
research
11/24/2019

Image Cropping with Composition and Saliency Aware Aesthetic Score Map

Aesthetic image cropping is a practical but challenging task which aims ...
research
05/24/2019

Saliency detection based on structural dissimilarity induced by image quality assessment model

The distinctiveness of image regions is widely used as the cue of salien...
research
04/07/2021

Image Composition Assessment with Saliency-augmented Multi-pattern Pooling

Image composition assessment is crucial in aesthetic assessment, which a...
research
08/13/2023

UGC Quality Assessment: Exploring the Impact of Saliency in Deep Feature-Based Quality Assessment

The volume of User Generated Content (UGC) has increased in recent years...

Please sign up or login with your details

Forgot password? Click here to reset