Motion-blurred Video Interpolation and Extrapolation

03/04/2021
by   Dawit Mureja Argaw, et al.
0

Abrupt motion of camera or objects in a scene result in a blurry video, and therefore recovering high quality video requires two types of enhancements: visual enhancement and temporal upsampling. A broad range of research attempted to recover clean frames from blurred image sequences or temporally upsample frames by interpolation, yet there are very limited studies handling both problems jointly. In this work, we present a novel framework for deblurring, interpolating and extrapolating sharp frames from a motion-blurred video in an end-to-end manner. We design our framework by first learning the pixel-level motion that caused the blur from the given inputs via optical flow estimation and then predict multiple clean frames by warping the decoded features with the estimated flows. To ensure temporal coherence across predicted frames and address potential temporal ambiguity, we propose a simple, yet effective flow-based rule. The effectiveness and favorability of our approach are highlighted through extensive qualitative and quantitative evaluations on motion-blurred datasets from high speed videos.

READ FULL TEXT

page 6

page 7

page 8

research
04/19/2021

Restoration of Video Frames from a Single Blurred Image with Motion Understanding

We propose a novel framework to generate clean video frames from a singl...
research
06/17/2022

Enhanced Bi-directional Motion Estimation for Video Frame Interpolation

We present a novel simple yet effective algorithm for motion-based video...
research
06/19/2022

Video frame interpolation for high dynamic range sequences captured with dual-exposure sensors

Video frame interpolation (VFI) enables many important applications that...
research
03/03/2019

Unsupervised Bi-directional Flow-based Video Generation from one Snapshot

Imagining multiple consecutive frames given one single snapshot is chall...
research
04/08/2021

Affine-modeled video extraction from a single motion blurred image

A motion-blurred image is the temporal average of multiple sharp frames ...
research
03/06/2023

Polar Prediction of Natural Videos

Observer motion and continuous deformations of objects and surfaces imbu...
research
04/18/2018

Temporal Unknown Incremental Clustering (TUIC) Model for Analysis of Traffic Surveillance Videos

Optimized scene representation is an important characteristic of a frame...

Please sign up or login with your details

Forgot password? Click here to reset