Audio-Visual Quality Assessment for User Generated Content: Database and Method

by   Yuqin Cao, et al.

With the explosive increase of User Generated Content (UGC), UGC video quality assessment (VQA) becomes more and more important for improving users' Quality of Experience (QoE). However, most existing UGC VQA studies only focus on the visual distortions of videos, ignoring that the user's QoE also depends on the accompanying audio signals. In this paper, we conduct the first study to address the problem of UGC audio and video quality assessment (AVQA). Specifically, we construct the first UGC AVQA database named the SJTU-UAV database, which includes 520 in-the-wild UGC audio and video (A/V) sequences, and conduct a user study to obtain the mean opinion scores of the A/V sequences. The content of the SJTU-UAV database is then analyzed from both the audio and video aspects to show the database characteristics. We also design a family of AVQA models, which fuse the popular VQA methods and audio features via support vector regressor (SVR). We validate the effectiveness of the proposed models on the three databases. The experimental results show that with the help of audio signals, the VQA models can evaluate the perceptual quality more accurately. The database will be released to facilitate further research.


page 1

page 2

page 3

page 4


Perceptual Quality Assessment of Omnidirectional Audio-visual Signals

Omnidirectional videos (ODVs) play an increasingly important role in the...

StableVQA: A Deep No-Reference Quality Assessment Model for Video Stability

Video shakiness is an unpleasant distortion of User Generated Content (U...

XGC-VQA: A unified video quality assessment model for User, Professionally, and Occupationally-Generated Content

With the rapid growth of Internet video data amounts and types, a unifie...

Aesthetics Driven Autonomous Time-Lapse Photography Generation by Virtual and Real Robots

Time-lapse photography is employed in movies and promotional films becau...

Analysis of Video Quality Datasets via Design of Minimalistic Video Quality Models

Blind video quality assessment (BVQA) plays an indispensable role in mon...

Automatic Organisation and Quality Analysis of User-Generated Content with Audio Fingerprinting

The increase of the quantity of user-generated content experienced in so...

DDH-QA: A Dynamic Digital Humans Quality Assessment Database

In recent years, large amounts of effort have been put into pushing forw...

Please sign up or login with your details

Forgot password? Click here to reset