Deep Local and Global Spatiotemporal Feature Aggregation for Blind Video Quality Assessment

09/07/2020
by   Wei Zhou, et al.
0

In recent years, deep learning has achieved promising success for multimedia quality assessment, especially for image quality assessment (IQA). However, since there exist more complex temporal characteristics in videos, very little work has been done on video quality assessment (VQA) by exploiting powerful deep convolutional neural networks (DCNNs). In this paper, we propose an efficient VQA method named Deep SpatioTemporal video Quality assessor (DeepSTQ) to predict the perceptual quality of various distorted videos in a no-reference manner. In the proposed DeepSTQ, we first extract local and global spatiotemporal features by pre-trained deep learning models without fine-tuning or training from scratch. The composited features consider distorted video frames as well as frame difference maps from both global and local views. Then, the feature aggregation is conducted by the regression model to predict the perceptual video quality. Finally, experimental results demonstrate that our proposed DeepSTQ outperforms state-of-the-art quality assessment algorithms.

READ FULL TEXT

page 1

page 3

research
10/30/2019

C3DVQA: Full-Reference Video Quality Assessment with 3D Convolutional Neural Network

Traditional video quality assessment (VQA) methods evaluate localized pi...
research
04/13/2018

SpatioTemporal Feature Integration and Model Fusion for Full Reference Video Quality Assessment

Perceptual video quality assessment models are either frame-based or vid...
research
05/09/2020

Comment on "No-Reference Video Quality Assessment Based on the Temporal Pooling of Deep Features"

In Neural Processing Letters 50,3 (2019) a machine learning approach to ...
research
03/13/2021

VMAF And Variants: Towards A Unified VQA

Video quality assessment (VQA) is now a fastgrowing subject, beginning t...
research
10/07/2016

Efficient Deep Aesthetic Image Classification using Connected Local and Global Features

In this paper we investigate the aesthetic image classification problem,...
research
05/07/2022

Deep Quality Assessment of Compressed Videos: A Subjective and Objective Study

In the video coding process, the perceived quality of a compressed video...
research
08/19/2021

Blindly Assess Quality of In-the-Wild Videos via Quality-aware Pre-training and Motion Perception

Perceptual quality assessment of the videos acquired in the wilds is of ...

Please sign up or login with your details

Forgot password? Click here to reset