Technical Report on Visual Quality Assessment for Frame Interpolation

01/16/2019
by   Hui Men, et al.
10

Current benchmarks for optical flow algorithms evaluate the estimation quality by comparing their predicted flow field with the ground truth, and additionally may compare interpolated frames, based on these predictions, with the correct frames from the actual image sequences. For the latter comparisons, objective measures such as mean square errors are applied. However, for applications like image interpolation, the expected user's quality of experience cannot be fully deduced from such simple quality measures. Therefore, we conducted a subjective quality assessment study by crowdsourcing for the interpolated images provided in one of the optical flow benchmarks, the Middlebury benchmark. We used paired comparisons with forced choice and reconstructed absolute quality scale values according to Thurstone's model using the classical least squares method. The results give rise to a re-ranking of 141 participating algorithms w.r.t. visual quality of interpolated frames mostly based on optical flow estimation. Our re-ranking result shows the necessity of visual quality assessment as another evaluation metric for optical flow and frame interpolation benchmarks.

READ FULL TEXT

page 1

page 3

page 4

page 5

research
01/10/2020

Subjective Annotation for a Frame Interpolation Benchmark using Artifact Amplification

Current benchmarks for optical flow algorithms evaluate the estimation e...
research
05/17/2023

IDO-VFI: Identifying Dynamics via Optical Flow Guidance for Video Frame Interpolation with Events

Video frame interpolation aims to generate high-quality intermediate fra...
research
04/29/2023

Relaxed forced choice improves performance of visual quality assessment methods

In image quality assessment, a collective visual quality score for an im...
research
12/20/2018

An Optical Flow-Based Approach for Minimally-Divergent Velocimetry Data Interpolation

Three-dimensional (3D) biomedical image sets are often acquired with in-...
research
07/17/2022

FloLPIPS: A Bespoke Video Quality Metric for Frame Interpoation

Video frame interpolation (VFI) serves as a useful tool for many video p...
research
05/27/2023

BASED: Benchmarking, Analysis, and Structural Estimation of Deblurring

This paper discusses the challenges of evaluating deblurring-methods qua...
research
06/08/2021

Design of Low-Artifact Interpolation Kernels by Means of Computer Algebra

We present a number of new piecewise-polynomial kernels for image interp...

Please sign up or login with your details

Forgot password? Click here to reset